-- Logs begin at Fri 2022-06-17 06:37:51 UTC, end at Fri 2022-06-17 07:24:19 UTC. -- Jun 17 07:12:19.961486 dv-cinder-803773-3-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jun 17 07:12:19.968655 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jun 17 07:12:19 2022] *** Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: nodename: dv-cinder-803773-3-iscsi Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: machine: x86_64 Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: clock source: unix Jun 17 07:12:19.970651 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: pcre jit disabled Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: detected number of CPU cores: 4 Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: current working directory: / Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: detected binary path: /usr/bin/uwsgi-core Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: your processes number limit is 47680 Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: your memory page size is 4096 bytes Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: detected max file descriptor number: 2048 Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: lock engine: pthread robust mutexes Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: thunder lock: enabled Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jun 17 07:12:19.971096 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 17 07:12:20.018852 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: Python main interpreter initialized at 0x558d685549c0 Jun 17 07:12:20.018852 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: python threads support enabled Jun 17 07:12:20.018852 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: your server socket listen backlog is limited to 100 connections Jun 17 07:12:20.018852 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: your mercy for graceful operations on workers is 90 seconds Jun 17 07:12:20.019239 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: mapped 403077 bytes (393 KB) for 2 cores Jun 17 07:12:20.019313 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: *** Operational MODE: preforking *** Jun 17 07:12:20.019574 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: *** uWSGI is running in multiple interpreter mode *** Jun 17 07:12:20.019574 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: spawned uWSGI master process (pid: 80065) Jun 17 07:12:20.019794 dv-cinder-803773-3-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jun 17 07:12:20.020691 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: spawned uWSGI worker 1 (pid: 80079, cores: 1) Jun 17 07:12:20.020691 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: spawned uWSGI worker 2 (pid: 80080, cores: 1) Jun 17 07:12:20.020860 dv-cinder-803773-3-iscsi devstack@keystone.service[80065]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 17 07:12:25.562640 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:12:25.562640 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: from cryptography.utils import int_from_bytes Jun 17 07:12:25.563388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:12:25.563388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: from cryptography.utils import int_from_bytes Jun 17 07:12:25.564797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:12:25.564797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: from cryptography.utils import int_from_bytes Jun 17 07:12:25.565263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 17 07:12:25.565263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: from cryptography.utils import int_from_bytes Jun 17 07:12:25.613847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:12:25.614034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:12:25.614225 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] command line args: [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:12:25.614501 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:12:25.614619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 17 07:12:25.614706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ================================================================================ {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:12:25.614822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 17 07:12:25.614902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] admin_token = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.615020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] command line args: [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 17 07:12:25.615152 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] config_dir = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.615297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 17 07:12:25.615372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.616042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ================================================================================ {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 17 07:12:25.616126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] config_source = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.616294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] admin_token = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.616376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] debug = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.616492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.616812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] config_dir = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.616812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] config_source = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] debug = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.617928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_config_append = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618303 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_dir = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_file = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_config_append = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.618867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_dir = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_file = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619254 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.619995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620320 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.620869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621025 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621820 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.621990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.622241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.622323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.622421 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] publish_errors = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.622520 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.622647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.622869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.58/identity {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] publish_errors = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623398 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623735 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] standard_threads = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623880 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.623980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] standard_threads = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] use_journal = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624717 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] use_json = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624898 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] use_stderr = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.624987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625059 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] use_syslog = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] use_journal = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] use_json = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625578 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.625674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] use_stderr = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.625751 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.625852 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] use_syslog = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.626007 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 17 07:12:25.626251 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626837 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.626992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627085 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.627993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628075 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628227 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628323 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628476 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628566 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.628946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629035 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629680 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.629966 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.630967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631245 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631642 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.631995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632609 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632700 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632841 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.632932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633072 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.633857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634014 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634801 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.634956 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635184 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635630 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635707 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.635963 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636585 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.636899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637358 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.637981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638325 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.638927 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639006 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.639942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640179 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640726 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.640917 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.641952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642190 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642431 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.642976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.643957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644578 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.644889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645757 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.645995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646229 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646303 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646467 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.646967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647201 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647746 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647910 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.647989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.648144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.648220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.648373 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.648460 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.648690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.648796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649035 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649110 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649287 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649770 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.649937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.650014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.650258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.650371 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.650490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.external = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.650714 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.650790 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.password = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] auth.token = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.651961 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.external = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.652971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.653930 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.654101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.654180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.password = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.654349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.654538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] auth.token = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.654773 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.654981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.655074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.655263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.655426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656745 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656814 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.656882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657037 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657367 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657779 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.657866 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658012 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658336 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.658956 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659524 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.659790 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.660983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661475 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661709 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661790 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.661942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.662029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.662188 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.662775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.662960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663536 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.663955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664185 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664506 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664749 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.664925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.665177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.665429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.665498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.665689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.665775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.665947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666919 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.666997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667237 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667687 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.667970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668442 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.668911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669112 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669192 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669444 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.669916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670166 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670314 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670393 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670630 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670781 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.670866 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671515 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671614 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.671897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672592 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.672975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673683 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673769 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.673997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674467 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.674951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675423 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675573 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.675936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676154 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676380 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676615 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.676997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677226 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677708 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.677794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.678525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.678611 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.678747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.678827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.678991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679450 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.679936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680020 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680479 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680646 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680726 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.680970 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.681917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682073 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682621 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682780 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.682860 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683018 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683484 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.683997 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684230 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684707 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.684945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685175 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.685965 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] role.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] role.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686836 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.686915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687394 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687552 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.687890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688053 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688614 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688761 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.688839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] role.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689083 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] role.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689235 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689479 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.689969 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690624 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.690936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.691975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692347 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692578 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.692895 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693037 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693116 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693672 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.693911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694304 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694616 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694770 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.694850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695559 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695831 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.695990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.696966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697045 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697516 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.697992 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698219 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698462 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698612 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698698 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.698933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.connection = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699590 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.699933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700180 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700649 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.700885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701354 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.701845 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.connection = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702000 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702560 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.702960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703268 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.703861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80080) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:12:25.703936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.704154 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.704402 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.704640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.704891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.705130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.705377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.705609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.705850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.706087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 17 07:12:25.706258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80079) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 17 07:12:25.821386 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.821548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.821750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.822133 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.822367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.822594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.830129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.831040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.859015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.859242 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.865587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.865822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.913714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.914425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.961840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.962074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.962669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:25.962910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.029873 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030066 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030208 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030391 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030793 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.030923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.031016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.031381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.054672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.054901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055198 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055615 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.055975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.056088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.056171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.056304 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.056521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.056736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.067537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.067639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.080804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.080981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.081926 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.082046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80080) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.082130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.082261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.082477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.082692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80079) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jun 17 07:12:26.100125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.100610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:12:26.100694 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.100821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:12:26.100950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.101149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:12:26.101231 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.101349 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jun 17 07:12:26.101430 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.101619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.101710 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.101879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.101960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.102137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.102218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.102394 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.112914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113456 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113721 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.113999 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.121983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.122254 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.125250 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.125527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.125610 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.125803 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.125884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126688 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.126956 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127403 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127671 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127753 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.127958 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.128038 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.128223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.155210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.155647 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.157149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.157376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.157546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.157826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.162618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.163015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.163125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.163293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.163391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.163805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.170857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.171051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.171136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.171332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.175595 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.175816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.175907 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176198 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.176938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.177030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.177201 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.177282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.177465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.177546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.177735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.196723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.196820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.197000 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.197084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.202297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.202464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.205934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.206080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.206333 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.206469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.211900 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.213383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.215455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.217006 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.219108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.219401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.219679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.219982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.220256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.220530 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.220682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.220980 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.221264 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.221546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.221823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.222102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.239466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.239743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.240027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.240284 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.241075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.241359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.241624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.241897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.248145 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.249760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.249845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.250112 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.251470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.251751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.254586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.254863 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.255141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.255423 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.255701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.256759 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.257034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.257311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.257599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.257884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.269320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.269598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.269874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.270148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.270515 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.270848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.271089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.271182 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.271376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.272275 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.272562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.272843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.273209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.273488 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.289645 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.291510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.292912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.294784 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.296215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.297925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.298122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.299572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.299878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.299963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.300159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.301529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.301807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.302090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.307667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.309306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.309391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.310979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.312507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.312797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.313183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.313459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.314254 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.314544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.314936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.315214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.323440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.323724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.324025 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.324936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.325224 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.325505 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.331866 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80080) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.332112 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.332387 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.332656 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.332927 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.333307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.333388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80079) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jun 17 07:12:26.333581 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.333677 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.333855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.333945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.334166 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.334746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.334939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335208 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335336 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335615 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.335999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80080) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.336196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.336465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.336735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.336997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.337277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.337540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80079) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jun 17 07:12:26.373131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d685549c0 pid: 80080 (default app) Jun 17 07:12:26.374962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x558d685549c0 pid: 80079 (default app) Jun 17 07:12:26.376472 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7559-982f-421b-9d66-e3e1a7d73dee None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:26.376772 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7559-982f-421b-9d66-e3e1a7d73dee None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:26.377049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc7559-982f-421b-9d66-e3e1a7d73dee None None] PATH_INFO: `/v3` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:26.381781 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 791 bytes} [Fri Jun 17 07:12:26 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:34.178597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:34.179054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:34.179145 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:34.183465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 1/2] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:34 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:12:34.188686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:34.189115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:34.189254 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:34.259506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: INFO dbcounter [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] Registered counter for database keystone Jun 17 07:12:34.280303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG oslo_db.sqlalchemy.engines [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80080) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:12:34.286850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writer thread running {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:12:34.465265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG passlib.handlers.bcrypt [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80080) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 07:12:34.465613 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG passlib.handlers.bcrypt [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80080) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 07:12:34.519498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:34.521139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:34.641305 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 454 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 07:12:34.831818 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:34.902238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: INFO dbcounter [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] Registered counter for database keystone Jun 17 07:12:34.921951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG oslo_db.sqlalchemy.engines [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80079) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 17 07:12:34.928139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writer thread running {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 17 07:12:35.047127 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36be5895-f7d0-4ce4-87d1-0ecd0ab64f3c None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:35.051350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81febd8e3c144628e032f30cc71dcf0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:35.052035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:35.052322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:35.052632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:35.060581 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:35.112704 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: WARNING keystone.common.rbac_enforcer.enforcer [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 07:12:35.112995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a09323b-92e0-4f51-bbcb-30aad072001d admin admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:35.123926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 2/4] 10.222.0.58 () {58 vars in 1324 bytes} [Fri Jun 17 07:12:34 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jun 17 07:12:35.129834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:35.147944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e28173-66ac-4e28-a2e2-d66256fc45e7 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:35.152319 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81febd8e3c144628e032f30cc71dcf0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:35.153459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:35.153748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:35.154026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] PATH_INFO: `/v3/projects/e81febd8e3c144628e032f30cc71dcf0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:35.155562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] RBAC: Authorizing `identity:get_project(project_id=e81febd8e3c144628e032f30cc71dcf0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:35.206660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: WARNING keystone.common.rbac_enforcer.enforcer [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jun 17 07:12:35.207124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5b67c2-fcea-47ae-8840-f9af7ae72c38 admin admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:35.216133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 3/5] 10.222.0.58 () {56 vars in 1207 bytes} [Fri Jun 17 07:12:35 2022] GET /identity/v3/projects/e81febd8e3c144628e032f30cc71dcf0 => generated 344 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:37.291421 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab070193-c5b5-4a89-8afc-f3da800705a6 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:37.292002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab070193-c5b5-4a89-8afc-f3da800705a6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:37.292002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab070193-c5b5-4a89-8afc-f3da800705a6 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:37.296132 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 3/6] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:37.301329 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:37.301759 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:37.301933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:37.321382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:37.322902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:37.330739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 4/7] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jun 17 07:12:37.353160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab070193-c5b5-4a89-8afc-f3da800705a6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:37.365475 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab070193-c5b5-4a89-8afc-f3da800705a6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:37.369659 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55e190f-ee2e-4d8c-bcd0-8b621d1d28d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81febd8e3c144628e032f30cc71dcf0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:37.370285 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e190f-ee2e-4d8c-bcd0-8b621d1d28d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:37.370578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e190f-ee2e-4d8c-bcd0-8b621d1d28d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:37.370855 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55e190f-ee2e-4d8c-bcd0-8b621d1d28d7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:37.378356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e190f-ee2e-4d8c-bcd0-8b621d1d28d7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:37.380134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55e190f-ee2e-4d8c-bcd0-8b621d1d28d7 admin admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:37.388627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 4/8] 10.222.0.58 () {58 vars in 1324 bytes} [Fri Jun 17 07:12:37 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jun 17 07:12:37.393556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:37.402379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b03f0c-ba8d-49d9-90ff-774d94a32e33 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:37.407044 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eed9cfa-d1b3-4e32-85e0-fb6daa8f3583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e81febd8e3c144628e032f30cc71dcf0', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:37.407931 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9cfa-d1b3-4e32-85e0-fb6daa8f3583 admin admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:37.408224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9cfa-d1b3-4e32-85e0-fb6daa8f3583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:37.408504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eed9cfa-d1b3-4e32-85e0-fb6daa8f3583 admin admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:37.409932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9cfa-d1b3-4e32-85e0-fb6daa8f3583 admin admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:37.412312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eed9cfa-d1b3-4e32-85e0-fb6daa8f3583 admin admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:37.413899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 5/9] 10.222.0.58 () {56 vars in 1198 bytes} [Fri Jun 17 07:12:37 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:39.633834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bdd27-03ca-44a8-91a4-835fd294a913 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:39.634351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bdd27-03ca-44a8-91a4-835fd294a913 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:39.634556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42bdd27-03ca-44a8-91a4-835fd294a913 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:39.637164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 5/10] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:12:39.645478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:39.646045 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:39.646459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:39.667700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:39.668949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:39.714295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227446-90d1-4ccd-a029-3e45d19d1246 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:39.714597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227446-90d1-4ccd-a029-3e45d19d1246 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:39.714882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227446-90d1-4ccd-a029-3e45d19d1246 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:39.716292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 6/11] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:12:39.721656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:39.721946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:39.722229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:39.756477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 6/12] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:39.761925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG passlib.handlers.bcrypt [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80079) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jun 17 07:12:39.762356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG passlib.handlers.bcrypt [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80079) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jun 17 07:12:39.779153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:39.802357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:39.808447 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:39.810054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:39.885279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cebec8c-fd7e-46da-98c2-c46bffe6a0ca None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:39.915648 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 7/13] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:12:39.918877 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:39.919748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:39.920070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:39.920357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:39.933983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:39.938773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:39.946267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:39.947327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:12:39.948338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 7/14] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:12:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:12:39.953150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:40.033473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:40.037561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed72b60a-f6e7-4e28-bdb7-35e89673d58f None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.040543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:40.053157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fd81d5-a327-4202-8ff7-af01275687e8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.075853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.076832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.077130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.077411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.088166 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.088844 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.089438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.089724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.090635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:40.090952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.092410 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.104093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 8/15] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:40.109485 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:40.144311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.145836 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.212083 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba14019b-f3ef-43b1-860f-5c4274daa83a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.246141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.246919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 8/16] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:12:40.247019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.247284 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.247568 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.248818 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.250287 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.256260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 9/17] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:40 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:40.256383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:40.256383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:40.257075 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:40.271815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:40.350269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a9ec42-4296-44f2-af6b-284c39033f70 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.355845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c2e9ce-5efb-430f-8dc1-e56f26a38f10 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.382342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.383211 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.383507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.383807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.388782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.389572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.389862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.390144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.391318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.392800 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.394447 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 10/18] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:40.400739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:40.402397 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.403874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:12:40.424696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:40.425521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:40.426316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:12:40.426316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:12:40.426316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:12:40.426316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:12:40.426316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 9/19] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:40.431620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:40.479895 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:40.487029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:40.499076 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f49e9-73fb-4c42-a93e-b087079cb05b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.530222 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18da053d-2a18-4007-b450-561df20c16bc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:40.532730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.533389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.533673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.533949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.534775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.domain.id=default, user.id=b8c1c83f1036474f9bd804fc73521ecc) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:40.535088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.536618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3055623f-d20b-4ba8-bb04-2360e4b35fd4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.543236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 11/20] 10.222.0.58 () {56 vars in 1322 bytes} [Fri Jun 17 07:12:40 2022] GET /identity/v3/role_assignments?user.id=b8c1c83f1036474f9bd804fc73521ecc&scope.domain.id=default&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 233 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:40.564452 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:40.565136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:40.565422 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:40.565701 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:40.566455 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:40.566764 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:40.568756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce77a74-2b32-4e9a-8173-0fa717a148f5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:40.588595 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 10/21] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:12:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:43.168440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bad5fd-0f5e-4282-9993-e4f04a0cc0bb None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.169278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bad5fd-0f5e-4282-9993-e4f04a0cc0bb None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.169782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bad5fd-0f5e-4282-9993-e4f04a0cc0bb None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.171344 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 12/22] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:43.176535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.176937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.177140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.200752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:43.202247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:43.298418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 11/23] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:43.332713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bad5fd-0f5e-4282-9993-e4f04a0cc0bb None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:43.476839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bad5fd-0f5e-4282-9993-e4f04a0cc0bb None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:43.528032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf69cd4-c83a-4743-9188-d22f3acb6fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:43.528852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69cd4-c83a-4743-9188-d22f3acb6fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.529139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69cd4-c83a-4743-9188-d22f3acb6fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.529418 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf69cd4-c83a-4743-9188-d22f3acb6fa5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.550523 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf69cd4-c83a-4743-9188-d22f3acb6fa5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-baf69cd4-c83a-4743-9188-d22f3acb6fa5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:43.558604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:43.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:12:43.560343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 13/24] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:12:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:43.565944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:43.664223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:43.697178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d6ff8-c4fb-45f3-8a43-9b233a694b18 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.697724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d6ff8-c4fb-45f3-8a43-9b233a694b18 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.698224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1d6ff8-c4fb-45f3-8a43-9b233a694b18 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.700446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 14/25] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:12:43.705779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c04a3-1fed-4be1-b358-36403ee4aa0c None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.706385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c04a3-1fed-4be1-b358-36403ee4aa0c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.706866 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8c04a3-1fed-4be1-b358-36403ee4aa0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.732525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:43.735992 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f189100-2b23-4cb3-a109-65324b2c1ea2 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:43.742827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-cd8c04a3-1fed-4be1-b358-36403ee4aa0c None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:43.744915 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-cd8c04a3-1fed-4be1-b358-36403ee4aa0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:43.779605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:43.780325 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.780620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.781172 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.781944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:43.782259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:43.783914 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a9cec2-b88a-4bbe-92a3-67ae9134a539 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:43.799369 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 12/26] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:43.800753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d94c03-7592-430e-89e6-5e4ff46d0533 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.801051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d94c03-7592-430e-89e6-5e4ff46d0533 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.801334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d94c03-7592-430e-89e6-5e4ff46d0533 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.802619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:43.803695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77641-f272-4235-bc7a-ce74e1b0cee8 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.804092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77641-f272-4235-bc7a-ce74e1b0cee8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.804382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc77641-f272-4235-bc7a-ce74e1b0cee8 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.805611 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 14/28] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:43.811046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.811342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.811629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.831563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 15/29] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:12:43.831995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:43.833766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:43.834172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:43.834659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:43.835147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:43.865420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:43.866929 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:43.935825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 15/30] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:43.940809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:43.971855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 16/31] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:43.972891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.017766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:44.046661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:44.087817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5169fede-2e8b-44e7-9dda-6833f448acc5 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.100661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9437c055-c1cb-4779-b192-2d9d65525235 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.133483 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.134173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.134471 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.134756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.135518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.136534 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.136967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.137466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.137761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.138039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.139586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.141076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.143964 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 16/32] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:43 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:44.144955 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.260931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9747a52-6f4e-47a7-a809-0e20dafd9242 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.271352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:44.307876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.308984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.309419 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.309842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.322125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.323650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:12:44.342623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:44.343503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:44.344390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:12:44.344390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:12:44.344390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:12:44.344390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:12:44.344390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 17/33] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:44.345448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.403806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 17/34] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 17 07:12:43 2022] POST /identity/v3/roles => generated 225 bytes in 423 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:12:44.403806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.470747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2da529a-2d85-4ad3-b60e-aa1d2b2b338e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.509167 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.509975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.510379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.510736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.510982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53312fe2-51b9-492c-950d-5d658032ef92 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.511634 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.513157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.538985 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:44.553688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c86462-e9da-4777-8622-8045336a4c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.554538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86462-e9da-4777-8622-8045336a4c6f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.554835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86462-e9da-4777-8622-8045336a4c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.555121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c86462-e9da-4777-8622-8045336a4c6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.556538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c86462-e9da-4777-8622-8045336a4c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.558155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c86462-e9da-4777-8622-8045336a4c6f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.564777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 18/35] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:44.566368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcae61-f79a-4821-9460-0cb32e37a2a1 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.566671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcae61-f79a-4821-9460-0cb32e37a2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.566963 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcae61-f79a-4821-9460-0cb32e37a2a1 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.568557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:44.569142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcae61-f79a-4821-9460-0cb32e37a2a1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.707181 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcae61-f79a-4821-9460-0cb32e37a2a1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.742587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.743264 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.743556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.743869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.744600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:44.744914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.746307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c613d-c1dc-45b0-bc8e-e15739c6c476 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.763808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 17 07:12:44 2022] POST /identity/v3/roles => generated 219 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:12:44.763808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.775110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:12:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:44.776730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.777099 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.777457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.794221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:44.801877 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:44.804587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:44.859949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:44.881859 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 21/39] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:44.889488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:44.892081 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48208377-62a5-4977-acb8-e6ebb571c8fb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:44.938809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704921d-d55a-41d4-82f5-e92fb4f927c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:44.940042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704921d-d55a-41d4-82f5-e92fb4f927c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.940342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704921d-d55a-41d4-82f5-e92fb4f927c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.940660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704921d-d55a-41d4-82f5-e92fb4f927c7 None admin] PATH_INFO: `/v3/domains/default/users/b8c1c83f1036474f9bd804fc73521ecc/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.942859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704921d-d55a-41d4-82f5-e92fb4f927c7 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=b8c1c83f1036474f9bd804fc73521ecc, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:44.944509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704921d-d55a-41d4-82f5-e92fb4f927c7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:44.963570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 19/40] 10.222.0.58 () {58 vars in 1361 bytes} [Fri Jun 17 07:12:44 2022] PUT /identity/v3/domains/default/users/b8c1c83f1036474f9bd804fc73521ecc/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:12:44.965895 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60860-d19a-46f4-a677-f323b7a9fef9 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:44.966195 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60860-d19a-46f4-a677-f323b7a9fef9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:44.966484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b60860-d19a-46f4-a677-f323b7a9fef9 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:44.972033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 20/41] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:44.972033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60860-d19a-46f4-a677-f323b7a9fef9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:45.018971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a270f0-cc59-4c69-bde4-028d722918ea None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:45.057084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c18922c-17b3-4183-93af-4dd0e49e39b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:45.057692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18922c-17b3-4183-93af-4dd0e49e39b1 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:45.057988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18922c-17b3-4183-93af-4dd0e49e39b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:45.058274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c18922c-17b3-4183-93af-4dd0e49e39b1 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:45.059015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18922c-17b3-4183-93af-4dd0e49e39b1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:45.060602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c18922c-17b3-4183-93af-4dd0e49e39b1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:45.074926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:45.094394 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:12:44 2022] POST /identity/v3/projects => generated 301 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:12:45.095584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:45.099819 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:45.099819 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:45.112850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b60860-d19a-46f4-a677-f323b7a9fef9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:45.127196 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:45.128418 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:45.171038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:45.173811 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:45.174515 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:45.174897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:45.175107 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:45.176386 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:45.179814 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:45.195181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 21/43] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 17 07:12:44 2022] POST /identity/v3/roles => generated 223 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:12:45.234256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 23/44] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:45.259542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:45.389229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854d1e6-63ee-4dc9-a163-fc8a6bd6eaeb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:45.425098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bfd6d-2b1f-4712-9bfd-966b54a66714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:45.425917 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bfd6d-2b1f-4712-9bfd-966b54a66714 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:45.426210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bfd6d-2b1f-4712-9bfd-966b54a66714 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:45.426497 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bfd6d-2b1f-4712-9bfd-966b54a66714 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:45.427722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bfd6d-2b1f-4712-9bfd-966b54a66714 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:45.429240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bfd6d-2b1f-4712-9bfd-966b54a66714 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:45.430938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 22/45] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:45.436747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:45.551446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e4fa90-505b-4293-8451-6ec31bc6e227 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:45.591288 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a75a08-554b-4107-b1d4-02144c490ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:45.591990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75a08-554b-4107-b1d4-02144c490ee6 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:45.592286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75a08-554b-4107-b1d4-02144c490ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:45.592573 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a75a08-554b-4107-b1d4-02144c490ee6 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:45.593300 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75a08-554b-4107-b1d4-02144c490ee6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:45.594779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a75a08-554b-4107-b1d4-02144c490ee6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:45.620067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:12:45 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:12:47.285965 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c5d1-662a-48c3-bbdb-c730f4e006ea None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.286978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c5d1-662a-48c3-bbdb-c730f4e006ea None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.287060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a5c5d1-662a-48c3-bbdb-c730f4e006ea None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.288481 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 23/47] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:47.296539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.297475 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.298375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.324769 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:47.325957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:47.336687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:47.391730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 25/48] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:47.415210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5c5d1-662a-48c3-bbdb-c730f4e006ea None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:47.426857 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:47.523336 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a5c5d1-662a-48c3-bbdb-c730f4e006ea None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:47.556674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:47.557483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.557773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.558055 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.569244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:47.578016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:47.579044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:12:47.580919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 24/49] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:12:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:47.585466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:47.684538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a115b39e-833f-4bc3-bbf3-8686e292edbc None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:47.717830 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:47.718512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.718802 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.719111 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.719906 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:47.720224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:47.721630 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44485ee5-ba24-49dc-8c05-669368eb22d3 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:47.730100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 26/50] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:47.736961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:47.808858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:47.845230 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c0af3b-0af6-47ab-be76-13af2b16131d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:47.863997 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317e1a0-a64f-4295-aa93-3f23d9418716 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.864395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317e1a0-a64f-4295-aa93-3f23d9418716 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.865194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317e1a0-a64f-4295-aa93-3f23d9418716 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.866574 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 27/51] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:12:47.871494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.871902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.872258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.879665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:47.880604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:47.880896 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:47.881180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:47.882390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:47.884594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:47.886635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 25/52] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:47 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:47.890920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:47.892012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:47.892166 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:47.894285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:47.965701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 28/53] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:47.990173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:47.995894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97230d25-d319-4c5a-a7d3-77086b43e749 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:48.029643 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:48.030443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:48.030998 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:48.031284 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:48.032524 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:48.034018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:48.035650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 26/54] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:48.042046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:48.044676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:48.090168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474ff3a-4ea1-4056-a723-b6e75569acb1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:48.130419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:48.131222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:48.131518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:48.131822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:48.133111 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:48.134596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:48.136487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 29/55] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:47 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:48.141950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:48.144207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba5c516-7b28-48bd-9cae-df58523ad3f5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:48.152601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:48.188207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:48.189190 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:48.189483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:48.189773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:48.190620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.domain.id=default, user.id=b8c1c83f1036474f9bd804fc73521ecc) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:48.190940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:48.192801 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c761af-dbdb-4735-82b7-8ffb1395a419 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:48.201112 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 27/56] 10.222.0.58 () {56 vars in 1322 bytes} [Fri Jun 17 07:12:48 2022] GET /identity/v3/role_assignments?user.id=b8c1c83f1036474f9bd804fc73521ecc&scope.domain.id=default&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:48.252366 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6a448-aeca-4a50-a9e3-b7ea90d9fccb None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:48.289054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48f654a-21d7-4a15-8ef6-c98040438ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:48.289742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f654a-21d7-4a15-8ef6-c98040438ff0 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:48.290031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f654a-21d7-4a15-8ef6-c98040438ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:48.290312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f654a-21d7-4a15-8ef6-c98040438ff0 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:48.291035 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f654a-21d7-4a15-8ef6-c98040438ff0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:48.292729 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48f654a-21d7-4a15-8ef6-c98040438ff0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:48.320161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 30/57] 10.222.0.58 () {60 vars in 1140 bytes} [Fri Jun 17 07:12:48 2022] POST /identity/v3/projects => generated 298 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:12:50.445481 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33527-4c54-4dc2-af63-3e48afe26e8d None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:50.445973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33527-4c54-4dc2-af63-3e48afe26e8d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:50.445973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe33527-4c54-4dc2-af63-3e48afe26e8d None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:50.447575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 28/58] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:50.452856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:50.453254 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:50.453435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:50.470007 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:50.471183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:50.522310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:50.537596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 31/59] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:50.563183 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe33527-4c54-4dc2-af63-3e48afe26e8d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:50.635116 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:50.674877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe33527-4c54-4dc2-af63-3e48afe26e8d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:50.707489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b575353-b1bf-4946-adf3-21228f1b6fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:50.708758 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b575353-b1bf-4946-adf3-21228f1b6fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:50.709042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b575353-b1bf-4946-adf3-21228f1b6fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:50.709318 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b575353-b1bf-4946-adf3-21228f1b6fc6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:50.710541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b575353-b1bf-4946-adf3-21228f1b6fc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:50.712016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b575353-b1bf-4946-adf3-21228f1b6fc6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:50.713629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 29/60] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:50.719134 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:50.818908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b214fa50-682e-4661-820e-b1a3d32171b3 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:50.852760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629f011-87e6-4db4-9561-e4658e026edc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:50.853437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629f011-87e6-4db4-9561-e4658e026edc None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:50.853728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629f011-87e6-4db4-9561-e4658e026edc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:50.854013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629f011-87e6-4db4-9561-e4658e026edc None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:50.854735 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629f011-87e6-4db4-9561-e4658e026edc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:50.856358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1629f011-87e6-4db4-9561-e4658e026edc None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:50.882601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 32/61] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:12:50 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:12:54.333584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd5e36-d7bf-4af4-9761-f8ca6e4a5ea6 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:54.334347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd5e36-d7bf-4af4-9761-f8ca6e4a5ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:54.334717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fd5e36-d7bf-4af4-9761-f8ca6e4a5ea6 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:54.336884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 30/62] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:54.345617 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:54.346312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:54.346592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:54.388024 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:54.390317 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:54.399022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216afe-aa60-4dea-9a85-f5fb9f9ec14e None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:54.399343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216afe-aa60-4dea-9a85-f5fb9f9ec14e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:54.399601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8216afe-aa60-4dea-9a85-f5fb9f9ec14e None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:54.401237 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:12:54.432943 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:54.433160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:54.433459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:54.464986 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:54.466534 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:54.481239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:54.551884 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 33/64] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:54.593861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:54.625418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 32/65] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:12:54.648888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:54.716618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:54.760233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78d0ad9-1a19-4dc4-a2c4-6e27af53f97f None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:54.783155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d3cf05-8a26-438a-99af-11e13449b443 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:54.823715 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:54.824945 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:54.825510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:54.826097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:54.837624 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:54.847003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:54.847904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:12:54.849299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:12:54.852048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 34/66] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:12:54.861322 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:54.873653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:54.874483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:54.874776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:54.875077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:54.904369 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:54.914137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:54.915194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:12:54.915976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:12:54.917422 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 33/67] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:12:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:12:54.923646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:54.984215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.053716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b1b8a-2439-4f7c-ba15-420c7c707eb0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.054643 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97406bf-9422-4647-8e36-2cc94931223a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.083161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.094151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.095030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.095362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.095690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.096226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.096521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:55.096878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:55.096977 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.097189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.097475 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.098300 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:55.098403 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b009bd6-50b8-4cb2-b620-65c611937fde None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:55.099152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:55.100689 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6832262a-3af4-41bb-a912-823e05a55a01 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:55.108256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 35/68] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:55.109535 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0478ea4-d187-467a-a386-a6c34506cbdc None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.109925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0478ea4-d187-467a-a386-a6c34506cbdc None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.110185 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0478ea4-d187-467a-a386-a6c34506cbdc None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.111631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 36/69] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:55.117551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9609a-3dac-4361-85c0-d600d3f601c3 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.117551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9609a-3dac-4361-85c0-d600d3f601c3 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.117551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e9609a-3dac-4361-85c0-d600d3f601c3 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.117551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 37/71] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:55.117966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 34/71] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:55.122029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.122321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.122651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.123252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9609a-3dac-4361-85c0-d600d3f601c3 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.141809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:55.143066 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:55.215794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 35/72] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:55.216809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.234933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.244447 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e9609a-3dac-4361-85c0-d600d3f601c3 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.283861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f08372c-791d-499a-9408-b2e5456b6d72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.284749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08372c-791d-499a-9408-b2e5456b6d72 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.285040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08372c-791d-499a-9408-b2e5456b6d72 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.285323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f08372c-791d-499a-9408-b2e5456b6d72 None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.298780 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08372c-791d-499a-9408-b2e5456b6d72 None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:55.300319 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f08372c-791d-499a-9408-b2e5456b6d72 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:55.302553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 38/73] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:55.303739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.304056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.304341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.320454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:55.321667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:55.324402 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b7cfb2-779a-45fb-a1d0-5f2ec69daf34 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.340800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.359282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473a384-dfe4-437f-aecf-6cbbc4acac57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.360202 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a384-dfe4-437f-aecf-6cbbc4acac57 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.360499 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a384-dfe4-437f-aecf-6cbbc4acac57 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.360781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473a384-dfe4-437f-aecf-6cbbc4acac57 None admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.362002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473a384-dfe4-437f-aecf-6cbbc4acac57 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:55.363466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473a384-dfe4-437f-aecf-6cbbc4acac57 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:55.365700 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 36/74] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:55.366884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9128-866d-4d92-bbb3-bf56bf713af3 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.367174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9128-866d-4d92-bbb3-bf56bf713af3 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.367456 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99d9128-866d-4d92-bbb3-bf56bf713af3 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.372950 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 37/75] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:55.372950 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9128-866d-4d92-bbb3-bf56bf713af3 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.394304 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 39/76] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:55.395240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.469363 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99d9128-866d-4d92-bbb3-bf56bf713af3 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.487070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.503527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3080809-e3e1-4944-a2ed-1e2f52c4c97f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.504518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca57f52-6e21-429f-b2a4-f423900a479f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.505351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57f52-6e21-429f-b2a4-f423900a479f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.505635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57f52-6e21-429f-b2a4-f423900a479f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.505914 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca57f52-6e21-429f-b2a4-f423900a479f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.516742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca57f52-6e21-429f-b2a4-f423900a479f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-2ca57f52-6e21-429f-b2a4-f423900a479f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:55.524461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:55.525359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:12:55.526119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 38/77] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:55.527019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.527466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.527753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.540614 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.541276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.541594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.541876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.545259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:55.546469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:55.586826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.611354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:55.612896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:55.616550 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 39/78] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:12:55.629203 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.710023 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.717516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaf391b-ad2c-4dba-89fe-f75e35c50d05 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.727435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 40/79] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:55.728311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.752886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.753463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.753752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.754033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.796374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.823214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:55.824733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:55.833073 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf13d88d-ee55-47d6-9ac0-0cdecf4e68b9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:55.869222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:55.870564 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:55.871092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:55.871507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:55.885936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:55.894309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:55.895371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 41/80] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:55.896584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.927058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 40/81] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:55.927970 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:55.944599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:55.998382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222e472c-84f3-4345-9db7-be7ef4cc5cfa None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.001257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.027200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4289f40d-5e10-498a-8cd5-b91b9746ca81 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.031681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.032391 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.032684 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.032967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.033716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:56.034032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.035448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.043775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 42/82] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.044594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.066493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.067875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.068163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.068440 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.069618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.071082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.072747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 41/83] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:12:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.073502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.148224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-881e2ee6-4504-458a-91bc-7f564f1b1aa2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.157487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.178900 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e518734-a09d-4ecf-8557-039e61f95565 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.184317 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.185194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.185485 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.185768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.186976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.188503 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.192451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 43/84] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.193159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.221008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.222061 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.222525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.222982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.224796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:56.225307 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.227606 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.241925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 42/85] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.241925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.247575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.326244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e2ad3e-1954-4a87-acea-9a09c343e04a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.361716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.362589 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.362878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.363164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.365049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.366522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.368264 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 44/86] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.368956 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a21e01-3cc3-428c-8690-92d6ce03103d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.369384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.404442 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.406092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.406387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.407138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.408410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.409860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.412126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 43/87] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.414540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.421807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.488619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19229cee-8aba-4e57-892b-7b8129f7a3a1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.493907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.526588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.526588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.526588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.526588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.529340 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.529340 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.533097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90f8c56-1296-440f-b077-92a0cc0f7a59 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.549309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 45/88] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:12:56 2022] POST /identity/v3/users => generated 289 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:12:56.550163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.587529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.588207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.588502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.588786 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.589668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=22548e1724c540eea9f0d7f84af2f81e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:56.590057 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.592803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.600880 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 44/89] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/role_assignments?user.id=22548e1724c540eea9f0d7f84af2f81e&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.606689 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.713521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.722868 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0832e2d-04c4-4905-baf7-5483637b1b30 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.758915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8e52-666d-4d6a-9144-fbdc987f48c4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.770495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.771955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.772383 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.772775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.774372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.776071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.778726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 46/90] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.779737 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.811346 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:56.812554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:56.812982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:56.813575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:56.814909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=b8c1c83f1036474f9bd804fc73521ecc) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:56.815645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:56.818349 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:56.824129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:56.826126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 45/91] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/role_assignments?user.id=b8c1c83f1036474f9bd804fc73521ecc&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:56.831725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:56.911516 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109737ef-15a6-4165-a05d-ea2ebf1f74f2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:56.970692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeac872-9d7c-4f86-b645-1eb23849ac0e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:57.014730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:57.015716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:57.016042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:57.016328 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:57.023013 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:57.023691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:57.024123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:57.024412 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:57.064258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:57.111582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:57.114992 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:57.115401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:57.116888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:57.117001 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:57.229576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 46/92] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:57.236620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:57.331865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 47/93] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:12:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:12:57.338152 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:57.400542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd088096-1f65-4550-b40e-965475900d84 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:57.409574 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:57.440306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:57.482664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:57.483941 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:57.484202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2d28e-04e7-4731-b590-43a39bb9a705 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:57.484645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:57.485142 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:57.492688 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:57.494603 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:57.496758 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 47/94] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:12:57 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:57.502527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:57.558038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:57.559270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:57.563811 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:57.564356 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] PATH_INFO: `/v3/projects/d96e02db27094d64a25fa07913066f69` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:57.566583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] RBAC: Authorizing `identity:get_project(project_id=d96e02db27094d64a25fa07913066f69)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:57.568854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:57.571552 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 48/95] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:12:57 2022] GET /identity/v3/projects/d96e02db27094d64a25fa07913066f69 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:57.577890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:57.727138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9c737a-f11f-442c-a718-e853c3fc8860 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:57.752292 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e94632-b5f8-460f-9b82-1f8f1bb0cc7c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:57.809069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:57.810060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:57.810390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:57.810727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:57.811014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:57.811283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:57.811379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:57.811884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:57.812149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=d96e02db27094d64a25fa07913066f69, user.id=22548e1724c540eea9f0d7f84af2f81e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:57.812468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:57.813405 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] RBAC: Adding query filter params (role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=22548e1724c540eea9f0d7f84af2f81e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:12:57.813940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64277c0-e3e8-4e32-ac96-a25d9929428f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:57.814148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:12:57.815963 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:57.817520 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ac8e63-89f1-4bf7-8007-819451a0fc1c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:12:57.825933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 49/96] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:12:57 2022] GET /identity/v3/role_assignments?user.id=22548e1724c540eea9f0d7f84af2f81e&scope.project.id=d96e02db27094d64a25fa07913066f69&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:12:57.835174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 48/97] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:12:57 2022] GET /identity/v3/role_assignments?user.id=22548e1724c540eea9f0d7f84af2f81e&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=482894a175b245f6b17bc1592bbbc982 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:12:59.471995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac7ee-387e-4b37-8915-04c396d1b280 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:59.472481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac7ee-387e-4b37-8915-04c396d1b280 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:59.472481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac7ee-387e-4b37-8915-04c396d1b280 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:59.474436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 50/98] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:59.479932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9ddde-00c4-41f0-9177-91ee2d99fad8 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:59.480812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9ddde-00c4-41f0-9177-91ee2d99fad8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:59.481299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f9ddde-00c4-41f0-9177-91ee2d99fad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:59.508739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-75f9ddde-00c4-41f0-9177-91ee2d99fad8 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:59.510282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-75f9ddde-00c4-41f0-9177-91ee2d99fad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:12:59.539381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:12:59.598650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 49/99] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:12:59.633395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ac7ee-387e-4b37-8915-04c396d1b280 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:59.778183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ac7ee-387e-4b37-8915-04c396d1b280 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:12:59.825973 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6326a71b-02c9-4dda-8e76-a530ba4f1890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:12:59.826794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a71b-02c9-4dda-8e76-a530ba4f1890 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:59.827088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a71b-02c9-4dda-8e76-a530ba4f1890 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:59.827373 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6326a71b-02c9-4dda-8e76-a530ba4f1890 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:59.849920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6326a71b-02c9-4dda-8e76-a530ba4f1890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:12:59.859602 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451bba4-aa7f-4b8d-ba79-964b8ad5d13c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:59.859938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451bba4-aa7f-4b8d-ba79-964b8ad5d13c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:59.860220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1451bba4-aa7f-4b8d-ba79-964b8ad5d13c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:59.861687 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 50/100] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-6326a71b-02c9-4dda-8e76-a530ba4f1890 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:12:59.864560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:12:59.865411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:12:59.866142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 51/101] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:12:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:12:59.872056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451bba4-aa7f-4b8d-ba79-964b8ad5d13c None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:12:59.882584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702078d8-2556-4446-b597-792fc1096fbd None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:12:59.882909 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702078d8-2556-4446-b597-792fc1096fbd None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:12:59.883164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702078d8-2556-4446-b597-792fc1096fbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:12:59.936496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-702078d8-2556-4446-b597-792fc1096fbd None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:12:59.938045 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-702078d8-2556-4446-b597-792fc1096fbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:00.018692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1451bba4-aa7f-4b8d-ba79-964b8ad5d13c None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.046113 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.070852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 52/102] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:00.072235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1219a-b80e-4617-a6d0-ce934e21be62 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.072528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1219a-b80e-4617-a6d0-ce934e21be62 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.072810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1219a-b80e-4617-a6d0-ce934e21be62 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.074371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 53/103] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:00.075482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212e4b4-e90e-490c-af15-b616234a1d01 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.075786 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212e4b4-e90e-490c-af15-b616234a1d01 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.079996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f212e4b4-e90e-490c-af15-b616234a1d01 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.081335 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 54/104] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:00 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:00.083058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.083354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.083638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.087218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.088103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.088403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.088692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.089756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] RBAC: Adding query filter params (name=reader) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:00.090077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:00.091656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6642b25-f479-44ae-a166-2fb3d74794be None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:00.104713 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 51/105] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:12:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:00.105287 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:00.106203 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.106561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:00.110966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.111373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.128863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:00.130749 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:00.150181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.198618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 55/106] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:00.199951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.212079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 52/107] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:00.213217 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.311040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae30bc8f-26cc-41d8-8f1e-6a83c8349600 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.335196 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.349300 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461972e8-9af1-447b-a296-a5f4343bfcb2 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.354839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b54692-0afd-4863-956a-226449c463cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.356032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b54692-0afd-4863-956a-226449c463cd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.356551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b54692-0afd-4863-956a-226449c463cd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.357044 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b54692-0afd-4863-956a-226449c463cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.367992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b54692-0afd-4863-956a-226449c463cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-85b54692-0afd-4863-956a-226449c463cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:00.376068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:00.376920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:00.377668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:00.384988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 56/108] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:00.384988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b54692-0afd-4863-956a-226449c463cd None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.389143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.390944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.391241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.391524 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] PATH_INFO: `/v3/users/219da657ff4b4aa1a2df87e4437fab2f` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.413624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] RBAC: Authorizing `identity:get_user(user_id=219da657ff4b4aa1a2df87e4437fab2f)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:00.415834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:00.418191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 53/109] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/users/219da657ff4b4aa1a2df87e4437fab2f => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:00.420344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.438301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.518280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b54692-0afd-4863-956a-226449c463cd None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.544380 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e33d770-c967-441a-a67e-aab20ebabb84 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.561009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.562373 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.562612 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.562902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.578543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:00.584383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.585440 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.585954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.586426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:00.587137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:00.588183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:00.589109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:00.590271 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:00.591432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 57/110] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:00.592295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.592398 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:00.594553 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 54/111] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:00.595526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.647928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.688125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.710479 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697614ab-5b07-4869-a1b0-1b7c7d5bf314 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.740318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3130f0ad-9265-4da0-bbaf-33b8df678e22 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.753721 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.754794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.755285 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.755999 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.788988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:00.789930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:00.790230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:00.790519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:00.791687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:00.792039 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:00.793734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:00.807897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 58/112] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:00.807897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:00.843596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:00.845205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:00.939372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.948621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:00.953306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91222af-dafb-472d-8111-fa01196d95ce None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:00.965247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 55/113] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:00.970135 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.010749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.011731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.012210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.013416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.014428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:01.014908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.017274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.033719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 59/114] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.035187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.089063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ba967c-6fef-4e57-abd0-cd645be72592 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.127535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.128158 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.128474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.128745 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.129517 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.130972 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.162039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 56/115] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:13:00 2022] POST /identity/v3/projects => generated 302 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:01.162728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.165876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea27273-17f1-4896-9bbb-5addc6c69f2c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.208544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:01.212608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.213651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.214123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.214415 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.215807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.217559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.219553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 60/116] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.220208 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.260241 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:01.296317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ec7355-b68d-42cb-9c32-e98d069c7fc4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.338014 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5cf38c-c29a-423a-b08d-b155219bc925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.338891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cf38c-c29a-423a-b08d-b155219bc925 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.339176 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cf38c-c29a-423a-b08d-b155219bc925 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.340249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5cf38c-c29a-423a-b08d-b155219bc925 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.340351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbc62ac-10d8-40e8-a0da-714e0641d63c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.340687 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cf38c-c29a-423a-b08d-b155219bc925 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.342816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5cf38c-c29a-423a-b08d-b155219bc925 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.344121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 57/117] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.345144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d8236-4248-44fc-a59f-dc686432516d None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.346134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d8236-4248-44fc-a59f-dc686432516d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.346134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d8236-4248-44fc-a59f-dc686432516d None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.347441 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 58/118] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:01.353148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb144a-c5b2-497d-b72b-ef49e7521d32 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.353441 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb144a-c5b2-497d-b72b-ef49e7521d32 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.353719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbb144a-c5b2-497d-b72b-ef49e7521d32 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.355220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 59/119] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:01.355982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb144a-c5b2-497d-b72b-ef49e7521d32 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.381071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0afbbe-9bff-4309-b2f7-0667d5564f19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.381884 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0afbbe-9bff-4309-b2f7-0667d5564f19 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.382176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0afbbe-9bff-4309-b2f7-0667d5564f19 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.382461 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0afbbe-9bff-4309-b2f7-0667d5564f19 None admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.384115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0afbbe-9bff-4309-b2f7-0667d5564f19 None admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.385359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0afbbe-9bff-4309-b2f7-0667d5564f19 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.387616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 61/120] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.388496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.388857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.389070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.407979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:01.409227 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:01.463755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:01.468602 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbb144a-c5b2-497d-b72b-ef49e7521d32 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.491787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 62/121] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:01.491787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.515739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9955c273-1289-450c-aee7-e2ec1f8f4bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.516748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c273-1289-450c-aee7-e2ec1f8f4bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.517039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c273-1289-450c-aee7-e2ec1f8f4bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.517319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9955c273-1289-450c-aee7-e2ec1f8f4bb1 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.518579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c273-1289-450c-aee7-e2ec1f8f4bb1 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.520379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:01.520806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9955c273-1289-450c-aee7-e2ec1f8f4bb1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.527472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 60/122] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.528676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.528974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.529261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.546117 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:01.548011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:01.604313 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf745355-fcea-43de-bdf7-662eb53f846f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.619335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 61/123] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:01.624079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.651136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.652392 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.652689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.653246 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.654112 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] RBAC: Adding query filter params (role.id=26adb17a84ba4c37b3b2020394d64a4a, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=219da657ff4b4aa1a2df87e4437fab2f) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:01.654694 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.657197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.666039 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 63/124] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/role_assignments?user.id=219da657ff4b4aa1a2df87e4437fab2f&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=26adb17a84ba4c37b3b2020394d64a4a => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.671527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.742860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:01.747421 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5670c981-006f-44aa-95f2-15df22b1e4bc None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.788940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:01.789445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.790902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.791424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.791875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.793492 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.795913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.798378 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 62/125] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:01.799365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.799975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4944b2c-08cb-4d72-9ad4-eeb60cddc03b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.845046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.846396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.846396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.846592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.859358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:01.869125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:01.870051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:01.870933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 64/126] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:01.871594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:01.932207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580481c1-fcfe-4057-9197-2df996280014 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:01.971826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:01.973193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:01.973589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:01.973884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/22548e1724c540eea9f0d7f84af2f81e/roles/ab8f66c9c17141c78f03d685bacac0dd` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:01.976160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] RBAC: Authorizing `identity:create_grant(project_id=43c77278a4704b0a83a8ddd7e9eeafc0, user_id=22548e1724c540eea9f0d7f84af2f81e, role_id=ab8f66c9c17141c78f03d685bacac0dd)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:01.977743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:01.996904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 63/127] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:01 2022] PUT /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/22548e1724c540eea9f0d7f84af2f81e/roles/ab8f66c9c17141c78f03d685bacac0dd => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:02.000637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.006412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca98969-3121-46c2-97da-4b93638af49e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.064439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:02.079161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.081427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.081781 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.082361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.107339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:02.123743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:02.124713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:02.125478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:02.132853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 65/128] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:02.134107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.169322 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:02.222537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e47ad51-6f38-4263-a6c2-8675efe76d42 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.269994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.271171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.271463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.272669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/b8c1c83f1036474f9bd804fc73521ecc/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.274789 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] RBAC: Authorizing `identity:create_grant(project_id=43c77278a4704b0a83a8ddd7e9eeafc0, user_id=b8c1c83f1036474f9bd804fc73521ecc, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:02.276383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:02.297472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 64/129] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:01 2022] PUT /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/b8c1c83f1036474f9bd804fc73521ecc/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:02.299720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.310238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5961fc3d-c52c-4fed-afdf-162231c61a72 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.365027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.365991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.366421 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.366842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.367777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:02.368357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:02.372310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:02.390918 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 66/130] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:02.397339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.468776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:02.498380 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b471b-164a-4219-8220-55d97b2919e7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.556990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:02.578487 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.579197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.579498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.579807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.580597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:02.580921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:02.582429 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:02.605293 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 65/131] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:02.611481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78ffb99-ce27-44ea-9f54-e5ffbbf9b70d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.614372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.676537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.677814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.678295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.678915 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.683487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:02.685178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:02.687202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 67/132] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:02 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:02.693549 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.769229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bc18c6-8e3f-4e6d-a676-cb91f464e6ff None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.858009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.858990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.859221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.859498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.864843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:02.866301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:02.868206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 66/133] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:02 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:02.876711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.881439 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9850cea2-feaf-474d-909f-0d3f30c1bd8d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:02.918520 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:02.918914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:02.920089 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:02.920601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:02.921126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:02.922653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:02.924577 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:02.927440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 68/134] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:02 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:02.933353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:02.952727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:03.046679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9bd3d-9a91-44ca-a2c2-91c0fb02e32d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:03.049082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353dcfaf-bdb1-454b-9e10-ecfaf76acf43 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:03.083815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56008ee-d367-4c02-8175-593115c6ed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:03.085260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56008ee-d367-4c02-8175-593115c6ed95 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:03.085756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56008ee-d367-4c02-8175-593115c6ed95 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:03.086324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56008ee-d367-4c02-8175-593115c6ed95 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/22548e1724c540eea9f0d7f84af2f81e/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:03.087728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:03.089037 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:03.089406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:03.089602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56008ee-d367-4c02-8175-593115c6ed95 None admin] RBAC: Authorizing `identity:create_grant(project_id=43c77278a4704b0a83a8ddd7e9eeafc0, user_id=22548e1724c540eea9f0d7f84af2f81e, role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:03.089809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] PATH_INFO: `/v3/projects/d96e02db27094d64a25fa07913066f69` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:03.091170 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] RBAC: Authorizing `identity:get_project(project_id=d96e02db27094d64a25fa07913066f69)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:03.091669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56008ee-d367-4c02-8175-593115c6ed95 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:03.092836 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:03.095191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 67/135] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:02 2022] GET /identity/v3/projects/d96e02db27094d64a25fa07913066f69 => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:03.101373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:03.115705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 69/136] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:02 2022] PUT /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/22548e1724c540eea9f0d7f84af2f81e/roles/482894a175b245f6b17bc1592bbbc982 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:13:03.238039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:03.257174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80177e3c-69ad-4eac-b5c5-7c3285ff0c10 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:03.304640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfd1431-edf4-4fbe-9d24-8238aad63673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:03.305545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd1431-edf4-4fbe-9d24-8238aad63673 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:03.305843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd1431-edf4-4fbe-9d24-8238aad63673 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:03.306130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfd1431-edf4-4fbe-9d24-8238aad63673 None admin] PATH_INFO: `/v3/projects/d96e02db27094d64a25fa07913066f69/users/22548e1724c540eea9f0d7f84af2f81e/roles/ab8f66c9c17141c78f03d685bacac0dd` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:03.310100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd1431-edf4-4fbe-9d24-8238aad63673 None admin] RBAC: Authorizing `identity:create_grant(project_id=d96e02db27094d64a25fa07913066f69, user_id=22548e1724c540eea9f0d7f84af2f81e, role_id=ab8f66c9c17141c78f03d685bacac0dd)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:03.311607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfd1431-edf4-4fbe-9d24-8238aad63673 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:03.354140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 68/137] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:03 2022] PUT /identity/v3/projects/d96e02db27094d64a25fa07913066f69/users/22548e1724c540eea9f0d7f84af2f81e/roles/ab8f66c9c17141c78f03d685bacac0dd => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:13:03.874151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cfa49-4949-41d2-baa9-843b7b768e29 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:03.874652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cfa49-4949-41d2-baa9-843b7b768e29 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:03.874724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cfa49-4949-41d2-baa9-843b7b768e29 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:03.876406 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 70/138] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:03.882504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:03.882943 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:03.883124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:03.901897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:03.903265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:04.006452 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 69/139] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:04.052766 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cfa49-4949-41d2-baa9-843b7b768e29 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:04.148079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:04.199097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cfa49-4949-41d2-baa9-843b7b768e29 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:04.244273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811839d0-149f-41a6-aea4-210092598e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:04.245530 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811839d0-149f-41a6-aea4-210092598e1b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:04.246050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811839d0-149f-41a6-aea4-210092598e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:04.246525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811839d0-149f-41a6-aea4-210092598e1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:04.251381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811839d0-149f-41a6-aea4-210092598e1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:04.253139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811839d0-149f-41a6-aea4-210092598e1b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:04.256661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 71/140] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:04.264867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:04.384287 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:04.419685 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990091d6-1c5f-42f4-b38e-c24b08a8e037 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:04.465932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d88ca09-93b3-46a5-82cc-3d4f466dcba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:04.466639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88ca09-93b3-46a5-82cc-3d4f466dcba2 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:04.466932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88ca09-93b3-46a5-82cc-3d4f466dcba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:04.467213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d88ca09-93b3-46a5-82cc-3d4f466dcba2 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:04.467981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88ca09-93b3-46a5-82cc-3d4f466dcba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:04.469439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d88ca09-93b3-46a5-82cc-3d4f466dcba2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:04.503075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 70/141] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:04 2022] POST /identity/v3/users => generated 283 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:04.700313 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e34f8-f72c-4c9d-97c0-67b08e697dde None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:04.701007 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e34f8-f72c-4c9d-97c0-67b08e697dde None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:04.701500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e34f8-f72c-4c9d-97c0-67b08e697dde None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:04.703197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 72/142] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:04.709484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:04.709793 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:04.710084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:04.741036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:04.742302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:04.773488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a9d5-5969-4527-9b3f-4c57fa7900f2 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:04.774118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a9d5-5969-4527-9b3f-4c57fa7900f2 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:04.774636 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5a9d5-5969-4527-9b3f-4c57fa7900f2 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:04.776422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 73/143] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:04.782106 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:04.782754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:04.783226 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:04.817512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:04.819156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:04.824699 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 71/144] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:04.853047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:04.925581 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:04.943060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 74/145] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:04.972437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bc1d60-4e1c-4e2f-bf17-6cb1726fdee4 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:04.981814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.010817 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.011641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.011966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.012253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.024992 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:05.034432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:05.035890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:05.036666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 72/146] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:05.043115 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.117740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:05.159091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57679ee5-a76d-43e9-87e0-2e6881742293 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.200060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:05.205384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f1c9a3-2314-4263-aca0-7c114697cd61 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.236445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.237454 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.237934 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.238451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.239428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:05.240746 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:05.242366 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:05.262477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 73/147] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:05.268761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.288005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.289151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.289628 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.290096 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.312022 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:05.326021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:05.326911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:05.327668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 75/148] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:05.333916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.445275 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f26cd-90e3-46af-9537-976b3121bf5a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.482170 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.482921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.483212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.483491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.484771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:05.486243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:05.488160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 74/149] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:05.495797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.522824 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc985b1d-7a88-484d-941f-9c4875e06fec None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.559796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:05.561199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:05.576853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.577663 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.577957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.578243 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.579008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:05.579324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:05.580768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:05.597345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 76/150] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:05.603833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.611125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c834e1a6-6c49-4e01-9dc0-8fedd4a2473f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.649215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.649889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.650198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.650465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.765232 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400477e7-e493-4716-ba5f-4017258fd579 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.781342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:05.782844 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:05.832249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:05.833611 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:05.833908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:05.834194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] PATH_INFO: `/v3/users/219da657ff4b4aa1a2df87e4437fab2f` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:05.835669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] RBAC: Authorizing `identity:get_user(user_id=219da657ff4b4aa1a2df87e4437fab2f)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:05.837357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:05.839605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 77/151] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/users/219da657ff4b4aa1a2df87e4437fab2f => generated 289 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:05.845374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:05.882774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:05.928036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:05.989193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 75/152] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:13:05.989813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45885a6b-8d2c-431d-a32a-301e62dab472 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:05.996482 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:06.038609 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:06.039424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:06.039716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:06.040032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:06.042276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:06.044720 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:06.047072 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 78/153] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:06.053645 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:06.188219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cfae20f-657c-4b81-8d15-00f8ae064344 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:06.243481 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:06.244401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:06.244690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:06.244974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:06.246396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:06.247931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:06.249878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 76/154] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:05 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:06.251786 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34291a4-29dc-4e5d-a555-e365b85555f5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:06.260119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:06.297382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:06.308132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:06.324214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84055835-aad1-453a-bf1f-f1b13e4240d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:06.327167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055835-aad1-453a-bf1f-f1b13e4240d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:06.327450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055835-aad1-453a-bf1f-f1b13e4240d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:06.327729 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84055835-aad1-453a-bf1f-f1b13e4240d1 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/219da657ff4b4aa1a2df87e4437fab2f/roles/26adb17a84ba4c37b3b2020394d64a4a` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:06.332862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84055835-aad1-453a-bf1f-f1b13e4240d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=43c77278a4704b0a83a8ddd7e9eeafc0, user_id=219da657ff4b4aa1a2df87e4437fab2f, role_id=26adb17a84ba4c37b3b2020394d64a4a)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:06.338113 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84055835-aad1-453a-bf1f-f1b13e4240d1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:06.361612 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 79/155] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:06 2022] PUT /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/users/219da657ff4b4aa1a2df87e4437fab2f/roles/26adb17a84ba4c37b3b2020394d64a4a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:06.437737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88774f74-91b8-491f-9494-45bf6236470f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:06.479035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:06.479739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:06.480067 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:06.480348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:06.481230 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=22548e1724c540eea9f0d7f84af2f81e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:06.481550 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:06.483141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060da799-5e15-49dc-87d5-cde8f6c685b2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:06.490717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 77/156] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:06 2022] GET /identity/v3/role_assignments?user.id=22548e1724c540eea9f0d7f84af2f81e&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 608 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:06.741787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19f7c7-775f-4e81-98a2-67b178ceaba1 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:06.742189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19f7c7-775f-4e81-98a2-67b178ceaba1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:06.742366 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed19f7c7-775f-4e81-98a2-67b178ceaba1 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:06.744064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 80/157] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:06.761498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:06.761805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:06.762071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:06.785709 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:06.786951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:06.873912 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 78/158] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:06.899662 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19f7c7-775f-4e81-98a2-67b178ceaba1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:07.020527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed19f7c7-775f-4e81-98a2-67b178ceaba1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:07.063402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91aa55f3-64fc-47b0-a300-a6819da39409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:07.064255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa55f3-64fc-47b0-a300-a6819da39409 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.064545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa55f3-64fc-47b0-a300-a6819da39409 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.064826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aa55f3-64fc-47b0-a300-a6819da39409 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.078282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91aa55f3-64fc-47b0-a300-a6819da39409 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-91aa55f3-64fc-47b0-a300-a6819da39409 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:07.087261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:07.088293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:07.089164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 81/159] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:07.094705 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:07.112139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:07.212631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16646e-cb7c-4f38-bb86-d985215cf4d9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:07.252644 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f154f-b4a9-4822-a0b7-6cac0688587e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.252976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f154f-b4a9-4822-a0b7-6cac0688587e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.253222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24f154f-b4a9-4822-a0b7-6cac0688587e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.254737 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 82/160] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:07.257789 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:07.258526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.258813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.259134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.259933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:07.260250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:07.261666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:07.265304 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fee49-ca2a-460e-9ad6-0515821f8a41 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.265586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fee49-ca2a-460e-9ad6-0515821f8a41 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.265870 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310fee49-ca2a-460e-9ad6-0515821f8a41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.287333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 79/161] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:07.291343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-310fee49-ca2a-460e-9ad6-0515821f8a41 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:07.292674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-310fee49-ca2a-460e-9ad6-0515821f8a41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:07.295716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:07.392126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:07.430142 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:07.438630 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 83/162] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:07.440499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d853f-bab5-4147-b719-e0bfbd74efd4 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.441055 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d853f-bab5-4147-b719-e0bfbd74efd4 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.443626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8d853f-bab5-4147-b719-e0bfbd74efd4 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.445371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 84/163] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:07.451066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.451620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.452113 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.459716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd4e162-6d0e-4913-8533-eaa468ce2cb8 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:07.484862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:07.486050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:07.495594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:07.496882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.497403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.497908 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] PATH_INFO: `/v3/users/b8c1c83f1036474f9bd804fc73521ecc` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.499416 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] RBAC: Authorizing `identity:get_user(user_id=b8c1c83f1036474f9bd804fc73521ecc)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:07.501166 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:07.503290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 80/164] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:07 2022] GET /identity/v3/users/b8c1c83f1036474f9bd804fc73521ecc => generated 247 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:07.505076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:07.610438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307806ff-0616-4f64-9058-2154ee6f115b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:07.616014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 85/165] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:07.617386 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:07.674730 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:07.676549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.677048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.677552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.694393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:07.712503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:07.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:07.714206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:07.716968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 81/166] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:07.722260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:07.726243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:07.865951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fb4d55-4b5a-458f-b613-db48d81215f1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:07.882478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:07.892273 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee888aa1-4543-42a5-aa26-351d46bd9f62 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:07.957552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:07.958391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.958675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.958957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.970274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:07.970955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:07.971247 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:07.971541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:07.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:08.001149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:08.002098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:08.002859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 82/167] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:08.003584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:08.103510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:08.105119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:08.105854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:08.212779 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31005de-fb8b-4101-8042-8ede5b3eee9d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:08.287913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:08.288602 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:08.288887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:08.289167 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:08.289929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:08.290237 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:08.291631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:08.311241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 83/168] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:08.312166 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:08.318362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 86/169] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:08.319216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:08.338419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:08.524986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f852c8b2-0ed5-46d2-8144-6b8c76e63ff4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:08.526135 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19d6e42-f215-4179-a2ef-bd48a12623de None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:08.565559 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:08.586394 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:08.587490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:08.587790 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:08.588096 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:08.588394 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:08.589089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:08.589318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:08.589429 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:08.589642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:08.590417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:08.590733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:08.590831 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:08.592153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:08.592605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 87/170] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:08 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:08.593204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:08.611354 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 84/171] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:08.612280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:08.681784 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:08.726187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66324-39da-429c-9217-f591d4921af2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:08.794088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:08.795396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:08.795907 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:08.796397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:08.799276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:08.801617 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:08.805019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 88/172] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:08 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:08.806136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:08.882364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb96ead-8865-4f52-9a71-db5705fdd66a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:08.982824 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec8b74-a243-4fc0-954d-50c2a55e1bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:08.983751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8b74-a243-4fc0-954d-50c2a55e1bcc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:08.984167 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8b74-a243-4fc0-954d-50c2a55e1bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:08.984562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec8b74-a243-4fc0-954d-50c2a55e1bcc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.003500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cdaf99-965d-458a-ab9e-677da794e81b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:09.074104 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:09.074916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.075206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.075496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] PATH_INFO: `/v3/users/22548e1724c540eea9f0d7f84af2f81e` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.076770 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] RBAC: Authorizing `identity:get_user(user_id=22548e1724c540eea9f0d7f84af2f81e)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:09.078256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:09.080269 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 89/173] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:08 2022] GET /identity/v3/users/22548e1724c540eea9f0d7f84af2f81e => generated 275 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:09.081136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:09.091272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:09.099138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:09.121008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec8b74-a243-4fc0-954d-50c2a55e1bcc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:09.122508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec8b74-a243-4fc0-954d-50c2a55e1bcc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:09.218890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15573183-0478-46a0-a9fc-8fee6bfb8272 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:09.267373 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:09.268092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.268379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.268656 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.270054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=b8c1c83f1036474f9bd804fc73521ecc) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:09.270371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:09.271900 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65213f9f-58b4-43b3-ba96-6a3ccba0d6d4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:09.289633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 90/174] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:09 2022] GET /identity/v3/role_assignments?user.id=b8c1c83f1036474f9bd804fc73521ecc&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:09.290999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b184f2-e9b8-4edc-be45-83e93300e8da None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.291291 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b184f2-e9b8-4edc-be45-83e93300e8da None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.291572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b184f2-e9b8-4edc-be45-83e93300e8da None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.293263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 91/175] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:09.294209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b184f2-e9b8-4edc-be45-83e93300e8da None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:09.320175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 85/176] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 708 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:09.323420 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.323862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.324385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.375078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:09.376339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:09.428979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:09.479826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b184f2-e9b8-4edc-be45-83e93300e8da None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:09.515532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 86/177] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:09.516446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:09.528334 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:09.529146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.529432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.529717 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.536031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:09.614295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:09.615701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:09.642169 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2482a08-73dc-41b5-a54f-fd977ada5e06 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:09.684043 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f435756-52ef-450b-8898-ecf925fafb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:09.685010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435756-52ef-450b-8898-ecf925fafb8c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.685290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435756-52ef-450b-8898-ecf925fafb8c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.685737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f435756-52ef-450b-8898-ecf925fafb8c None admin] PATH_INFO: `/v3/projects/d96e02db27094d64a25fa07913066f69` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.686929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435756-52ef-450b-8898-ecf925fafb8c None admin] RBAC: Authorizing `identity:get_project(project_id=d96e02db27094d64a25fa07913066f69)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:09.688416 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f435756-52ef-450b-8898-ecf925fafb8c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:09.690122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 87/178] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:09 2022] GET /identity/v3/projects/d96e02db27094d64a25fa07913066f69 => generated 312 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:09.696069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f3d55-6413-4adb-afcd-a07b33f643f4 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.696069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f3d55-6413-4adb-afcd-a07b33f643f4 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.696069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f3d55-6413-4adb-afcd-a07b33f643f4 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.696069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 88/179] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:09.696069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fce50-4572-4c8a-8476-de415df4e0e9 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.696069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fce50-4572-4c8a-8476-de415df4e0e9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.696431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15fce50-4572-4c8a-8476-de415df4e0e9 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.696431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 89/180] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:09.697906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fce50-4572-4c8a-8476-de415df4e0e9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:09.721498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:09.751827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 92/181] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:09.753020 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:09.814143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:09.836383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15fce50-4572-4c8a-8476-de415df4e0e9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:09.876045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d19a502-f685-4243-872a-ba2f3c21d3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:09.876983 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a502-f685-4243-872a-ba2f3c21d3cf None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.877274 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a502-f685-4243-872a-ba2f3c21d3cf None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.877554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d19a502-f685-4243-872a-ba2f3c21d3cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.892399 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d19a502-f685-4243-872a-ba2f3c21d3cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:09.893103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721ced-5aa7-475e-b3c1-ac43f2c12632 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9d19a502-f685-4243-872a-ba2f3c21d3cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:09.900747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:09.901641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:09.902413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 90/182] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:09.903582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.903582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.903731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.924603 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:09.926619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:09.936301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:09.936973 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.937255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.937535 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.938375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=d96e02db27094d64a25fa07913066f69, user.id=22548e1724c540eea9f0d7f84af2f81e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:09.938690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:09.940238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b723ee57-3828-4a96-903b-d7ed1eca8b76 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:09.947466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 93/183] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:09 2022] GET /identity/v3/role_assignments?user.id=22548e1724c540eea9f0d7f84af2f81e&scope.project.id=d96e02db27094d64a25fa07913066f69&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:09.948965 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:09.949248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:09.949528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:09.969173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:09.970458 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:10.016162 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.037778 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 91/184] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:10.039309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.076178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 94/185] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:10.076910 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.156940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.186879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e2c593-3c94-4553-bda5-efc9a695e123 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.204748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc88ef9c-f90f-45dc-a134-916386896b7a None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.223228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750f7a53-afc4-44b7-aa82-30016e651b48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.224367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f7a53-afc4-44b7-aa82-30016e651b48 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.224659 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f7a53-afc4-44b7-aa82-30016e651b48 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.224940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750f7a53-afc4-44b7-aa82-30016e651b48 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.226141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f7a53-afc4-44b7-aa82-30016e651b48 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.227607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750f7a53-afc4-44b7-aa82-30016e651b48 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.229373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 92/186] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:10.230582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c1ffd-040e-40a4-9812-e71ea70e08e7 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.230872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c1ffd-040e-40a4-9812-e71ea70e08e7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.231153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471c1ffd-040e-40a4-9812-e71ea70e08e7 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.232473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 93/187] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:10.233182 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c1ffd-040e-40a4-9812-e71ea70e08e7 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.244263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.244944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.245231 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.245512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.246274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:10.246586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.248032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.258566 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 95/188] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:10.259395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.302038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.356348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471c1ffd-040e-40a4-9812-e71ea70e08e7 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.366123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6974a620-f397-458d-87d3-bfb62fc927ae None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.389902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.390962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.391248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.391523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.400151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb10a60-6b65-40b9-9967-66c1b41f0a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.400955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb10a60-6b65-40b9-9967-66c1b41f0a79 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.401244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb10a60-6b65-40b9-9967-66c1b41f0a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.401526 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb10a60-6b65-40b9-9967-66c1b41f0a79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.401955 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:10.402724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb10a60-6b65-40b9-9967-66c1b41f0a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.404227 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb10a60-6b65-40b9-9967-66c1b41f0a79 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.406131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 96/189] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:10.408566 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f3025-ac50-461d-9469-acbdda852625 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.408806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f3025-ac50-461d-9469-acbdda852625 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.409090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919f3025-ac50-461d-9469-acbdda852625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:10.410748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:10.411627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 94/190] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:10.420204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.421953 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.437169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-919f3025-ac50-461d-9469-acbdda852625 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:10.438663 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-919f3025-ac50-461d-9469-acbdda852625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:10.506562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 97/191] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:10.507407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f3025-ac50-461d-9469-acbdda852625 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.536792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.539187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6738fbb-e6a1-46f2-882b-ddf0e1bdc69f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.574877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.575540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.575867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.576144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.576983 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] RBAC: Adding query filter params (role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=22548e1724c540eea9f0d7f84af2f81e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:10.577302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.578743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.586149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 95/192] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/role_assignments?user.id=22548e1724c540eea9f0d7f84af2f81e&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=482894a175b245f6b17bc1592bbbc982 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:10.586928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.614439 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919f3025-ac50-461d-9469-acbdda852625 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.656590 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.657497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.657770 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.658050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] PATH_INFO: `/v3/users/83e452c03fcc4304b0a0eb7c18e61793` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.677420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] RBAC: Authorizing `identity:get_user(user_id=83e452c03fcc4304b0a0eb7c18e61793)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.678884 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.685536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 98/193] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/users/83e452c03fcc4304b0a0eb7c18e61793 => generated 283 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:10.685536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.688719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.731604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13118a-3b72-4418-b107-48282bc683a7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.777077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.777776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.778062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.778334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.779067 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.780804 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.808260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 96/194] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:10 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:10.809520 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.809908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.834591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bacb64-1ac2-4b4a-843e-94ea2935b4e5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.880916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.881616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.881950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.882179 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:10.882946 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:10.883260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:10.884741 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:10.894510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 99/195] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:10.900860 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:10.947846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bd7a8c-5234-45d2-bde0-eb24c0e93526 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:10.973607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:10.990637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:10.990878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:10.991157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:10.991310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.005681 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:11.014886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:11.015939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:11.016712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 97/196] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:11.017360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.031789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7ecfdc-0d02-4b43-b290-affff71a437b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.080548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.081579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.081907 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.082195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.107022 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.160501 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4991625-601d-430f-a139-f4b4150a42ab None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.185962 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.188420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.208248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.209053 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.209335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.209621 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] PATH_INFO: `/v3/users/83e452c03fcc4304b0a0eb7c18e61793` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.210873 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] RBAC: Authorizing `identity:get_user(user_id=83e452c03fcc4304b0a0eb7c18e61793)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.212381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.214060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 98/197] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/users/83e452c03fcc4304b0a0eb7c18e61793 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:11.214926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.268529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.321415 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 100/198] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:11.322110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.327633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ed87c7-5457-4e4a-937c-d0f2e5189bd1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.363842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.364626 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.364918 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.365194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.365951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:11.366257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.367881 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.377073 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 99/199] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:11.378004 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.386975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.442654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321a977-9d08-4c7a-bb56-453493fc552d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.485363 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.486133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.486534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.486935 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.499811 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60274e-1bd4-4646-a07d-5cb51e5f0f14 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.536175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.550231 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.551946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.552411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.552825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.554650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.556742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.559673 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 100/200] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:11.560752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.593639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.596039 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.659081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.705978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad997577-d488-4686-833f-d0d9df3c17fc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.727927 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 101/201] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:11.729194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.760570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.762203 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.762413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.762812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] PATH_INFO: `/v3/users/219da657ff4b4aa1a2df87e4437fab2f` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.764896 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] RBAC: Authorizing `identity:get_user(user_id=219da657ff4b4aa1a2df87e4437fab2f)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.767103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.768891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 101/202] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/users/219da657ff4b4aa1a2df87e4437fab2f => generated 289 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:11.769826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.827956 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.846123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060e38e-00a1-41ed-a508-7c37a5bc830f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.883435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.884677 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.885177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.885648 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.886787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=83e452c03fcc4304b0a0eb7c18e61793) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:11.887307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.889075 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.893475 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8808fd-249e-422e-bf23-eb7b269676da None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:11.903022 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 102/203] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/role_assignments?user.id=83e452c03fcc4304b0a0eb7c18e61793&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:11.904432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:11.935794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:11.945345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:11.946800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:11.947239 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:11.947676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:11.949863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:11.956034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:11.956034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 102/204] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:11.961722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:12.088418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d37384-576a-49b1-beee-309767f6e9ed None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:12.116150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:12.136904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:12.137607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:12.137899 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:12.138188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:12.139067 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] RBAC: Adding query filter params (role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=83e452c03fcc4304b0a0eb7c18e61793) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:12.139394 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:12.140995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:12.143806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393fb573-708c-4dd2-8ccb-b413b4d2f822 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:12.155792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 103/205] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/role_assignments?user.id=83e452c03fcc4304b0a0eb7c18e61793&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=482894a175b245f6b17bc1592bbbc982 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:12.250567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:12.250567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:12.250567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:12.250567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:12.366863 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:12.368338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:12.396397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:12.504626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 103/206] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 601 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:12.510515 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:12.630744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c65c2a8-2ace-437e-ba70-ea289bec396a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:12.668254 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4870d02-02d5-4f3e-9c75-e1fa037ccb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:12.669134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4870d02-02d5-4f3e-9c75-e1fa037ccb95 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:12.669420 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4870d02-02d5-4f3e-9c75-e1fa037ccb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:12.669699 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4870d02-02d5-4f3e-9c75-e1fa037ccb95 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:12.670928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4870d02-02d5-4f3e-9c75-e1fa037ccb95 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:12.672438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4870d02-02d5-4f3e-9c75-e1fa037ccb95 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:12.674477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 104/207] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:12 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:12.680411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:12.806158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1c8016-9dab-4d35-942f-8d7698e9afd6 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:12.828270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:12.855002 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:12.855687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:12.856003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:12.856288 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:12.857506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] RBAC: Adding query filter params (role.id=26adb17a84ba4c37b3b2020394d64a4a, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0, user.id=219da657ff4b4aa1a2df87e4437fab2f) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:12.857963 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:12.860178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368be73a-1430-4526-8a08-c3c2e5705223 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:12.874202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 104/208] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:12 2022] GET /identity/v3/role_assignments?user.id=219da657ff4b4aa1a2df87e4437fab2f&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=26adb17a84ba4c37b3b2020394d64a4a => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:13.596457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb908c8-33b3-4c04-92bd-40604cc6ed7f None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:13.596939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb908c8-33b3-4c04-92bd-40604cc6ed7f None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:13.596939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb908c8-33b3-4c04-92bd-40604cc6ed7f None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:13.599169 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 105/209] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:13.605825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa186e13-217c-47f6-aa71-192b3eb50159 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:13.606499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa186e13-217c-47f6-aa71-192b3eb50159 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:13.606499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa186e13-217c-47f6-aa71-192b3eb50159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:13.624366 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-fa186e13-217c-47f6-aa71-192b3eb50159 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:13.625670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-fa186e13-217c-47f6-aa71-192b3eb50159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:13.713684 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 105/210] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:13.739084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb908c8-33b3-4c04-92bd-40604cc6ed7f None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:13.792550 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:13.798435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c38730-81d4-4201-8c6d-a2f1de917732 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:13.798781 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c38730-81d4-4201-8c6d-a2f1de917732 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:13.799005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c38730-81d4-4201-8c6d-a2f1de917732 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:13.801315 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 106/211] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:13.806517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:13.806854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:13.807087 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:13.826330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:13.827910 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:13.855355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb908c8-33b3-4c04-92bd-40604cc6ed7f None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:13.891682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:13.892779 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:13.893234 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:13.893960 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:13.895436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:13.897265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:13.899216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 106/212] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:13.905410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:13.907300 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 107/213] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:13.940070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:13.992435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:14.019286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd8297-054e-4ac0-8e0c-b89a8c07416e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:14.038325 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:14.059776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:14.060745 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.061135 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.061660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.062428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:14.064024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:14.064767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927ac87-021c-4bca-b566-3849cc511f87 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:14.089746 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 107/214] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:13 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:13:14.107949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:14.109120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.109606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.110147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.125642 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:14.135115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:14.136157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:14.136941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:14.139479 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 108/215] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:14.149646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:14.259005 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c84c92-e183-4705-a34d-fb55c3578c20 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:14.295850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:14.296535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.296824 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.297111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.297878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:14.298192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:14.299578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:14.309677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 108/216] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:14.315108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:14.426808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:14.435574 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b95fba-7bf5-4484-9326-b30bae3107f1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:14.471878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff709b0-a0e4-458c-b4b4-1776b2a8a76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:14.473406 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff709b0-a0e4-458c-b4b4-1776b2a8a76a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.473687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff709b0-a0e4-458c-b4b4-1776b2a8a76a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.473961 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff709b0-a0e4-458c-b4b4-1776b2a8a76a None admin] PATH_INFO: `/v3/users/ad495619c5cb440dbba915c8f3ef99fd` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.488415 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff709b0-a0e4-458c-b4b4-1776b2a8a76a None admin] RBAC: Authorizing `identity:get_user(user_id=ad495619c5cb440dbba915c8f3ef99fd)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:14.489902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff709b0-a0e4-458c-b4b4-1776b2a8a76a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:14.491703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 109/217] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:14 2022] GET /identity/v3/users/ad495619c5cb440dbba915c8f3ef99fd => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:14.497149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:14.536695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:14.614462 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8caa7-02e3-4133-aae4-2a557043c60b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:14.654175 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5898e1-7344-444a-9d48-7f038f4b8a8e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.654759 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5898e1-7344-444a-9d48-7f038f4b8a8e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.655568 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5898e1-7344-444a-9d48-7f038f4b8a8e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.656647 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749448ba-84c5-43ed-af87-4ec72f8dccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:14.657314 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749448ba-84c5-43ed-af87-4ec72f8dccea None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.657657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749448ba-84c5-43ed-af87-4ec72f8dccea None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.657942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749448ba-84c5-43ed-af87-4ec72f8dccea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.662126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 110/218] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:14.669670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f924-85a2-4eca-8ed3-7c6fbcc136a2 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.670073 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f924-85a2-4eca-8ed3-7c6fbcc136a2 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.670465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc6f924-85a2-4eca-8ed3-7c6fbcc136a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.732580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749448ba-84c5-43ed-af87-4ec72f8dccea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:14.733020 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-bbc6f924-85a2-4eca-8ed3-7c6fbcc136a2 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:14.734017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749448ba-84c5-43ed-af87-4ec72f8dccea None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:14.734728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-bbc6f924-85a2-4eca-8ed3-7c6fbcc136a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:14.776185 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:14.854778 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 109/219] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:14.856150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfdbe5-9181-46e2-9e60-f6a7ef6a5dad None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.856529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfdbe5-9181-46e2-9e60-f6a7ef6a5dad None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.856824 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adfdbe5-9181-46e2-9e60-f6a7ef6a5dad None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.858807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 110/220] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:14.865170 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfdbe5-9181-46e2-9e60-f6a7ef6a5dad None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:14.875330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 111/221] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:14.877725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:14.878138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:14.878568 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:14.902090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:14.903724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:14.996209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adfdbe5-9181-46e2-9e60-f6a7ef6a5dad None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.040031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 112/222] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:15.041589 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.063268 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.064544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.066333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.066817 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.068815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:15.070280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:15.072321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 111/223] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:14 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:15.073273 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.075411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:15.088167 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:15.169648 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee3a51-036a-49e9-b28e-0daa00344899 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.195088 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639efd82-5846-4943-8a0c-860bd1782e07 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.208232 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.209455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.209947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.210428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.222856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:15.232005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:15.232947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:15.233748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:15.234366 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.234366 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.234366 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.234366 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.236974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 113/224] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:15.238092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.246485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:15.254909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:15.256181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 112/225] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:15.257011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.324467 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:15.325695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:15.362313 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a45c2cb-dddb-4fe5-8ab3-85929f077418 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.372486 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b33807-2255-42ba-8dd4-c2ee18559d52 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.406057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.407126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.407816 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.408304 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.409384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=ad495619c5cb440dbba915c8f3ef99fd) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:15.410484 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:15.412455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:15.417140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.417836 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.418144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.418430 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.419411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:15.419772 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:15.420648 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 114/226] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/role_assignments?user.id=ad495619c5cb440dbba915c8f3ef99fd&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:15.421631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:15.421980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.452259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 113/227] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:15.459608 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.573979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6248c602-afc7-4489-8115-ee4bf1913c25 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.623246 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.625169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.625681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.625968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.626734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:15.627048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:15.629045 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:15.639745 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:15.646107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 115/228] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:15.654682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.697033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6092c5-b5c9-4ffc-ac76-186c74b08a3f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.722288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:15.742299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.743199 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.743495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.743810 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] PATH_INFO: `/v3/users/83e452c03fcc4304b0a0eb7c18e61793` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.752629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] RBAC: Authorizing `identity:get_user(user_id=83e452c03fcc4304b0a0eb7c18e61793)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:15.754822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:15.756699 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 114/229] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/users/83e452c03fcc4304b0a0eb7c18e61793 => generated 283 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:15.762124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.802484 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f35dfe7-8d17-4a1f-b0dd-5f23438d0b8a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:15.870079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:15.870890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:15.871178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:15.871458 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] PATH_INFO: `/v3/users/83e452c03fcc4304b0a0eb7c18e61793` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:15.872706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] RBAC: Authorizing `identity:get_user(user_id=83e452c03fcc4304b0a0eb7c18e61793)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:15.874345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:15.876443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 116/230] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/users/83e452c03fcc4304b0a0eb7c18e61793 => generated 283 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:15.883796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:15.990538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad49915-3de2-47f4-8c2b-458cd638edde None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:16.002416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:16.048101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2d1a01-0d6b-459f-8f1d-0db22da585b9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:16.086679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:16.087560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:16.087866 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:16.088152 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:16.089497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:16.091202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:16.093176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 117/231] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:16.100204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:16.105287 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:16.106273 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:16.106555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:16.106830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:16.112534 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:16.114053 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:16.115825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 115/232] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:15 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:16.121426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:16.209911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cb2004-4c79-439b-b090-1462541e7134 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:16.252279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd75ae3-c18b-4fce-87e1-04faf42f04ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:16.253195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75ae3-c18b-4fce-87e1-04faf42f04ea None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:16.253511 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75ae3-c18b-4fce-87e1-04faf42f04ea None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:16.253794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd75ae3-c18b-4fce-87e1-04faf42f04ea None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed/users/83e452c03fcc4304b0a0eb7c18e61793/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:16.255882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd75ae3-c18b-4fce-87e1-04faf42f04ea None admin] RBAC: Authorizing `identity:create_grant(project_id=9304cc0bba194ff5bca330be4184efed, user_id=83e452c03fcc4304b0a0eb7c18e61793, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:16.257374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd75ae3-c18b-4fce-87e1-04faf42f04ea None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:16.260756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:16.286618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:16.299133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 118/233] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:16 2022] PUT /identity/v3/projects/9304cc0bba194ff5bca330be4184efed/users/83e452c03fcc4304b0a0eb7c18e61793/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:16.357490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3fd527-76bd-4340-9147-75265e3a57e0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:16.414673 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e80b1f-5633-446d-bace-82fed96d61e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:16.416283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e80b1f-5633-446d-bace-82fed96d61e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:16.416795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e80b1f-5633-446d-bace-82fed96d61e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:16.417362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e80b1f-5633-446d-bace-82fed96d61e6 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed/users/83e452c03fcc4304b0a0eb7c18e61793/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:16.421516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e80b1f-5633-446d-bace-82fed96d61e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9304cc0bba194ff5bca330be4184efed, user_id=83e452c03fcc4304b0a0eb7c18e61793, role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:16.423328 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e80b1f-5633-446d-bace-82fed96d61e6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:16.451491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 116/234] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:16 2022] PUT /identity/v3/projects/9304cc0bba194ff5bca330be4184efed/users/83e452c03fcc4304b0a0eb7c18e61793/roles/482894a175b245f6b17bc1592bbbc982 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:13:16.929998 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ea9ef-d525-468e-b881-3464d7a7588b None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:16.930506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ea9ef-d525-468e-b881-3464d7a7588b None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:16.930578 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408ea9ef-d525-468e-b881-3464d7a7588b None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:16.932459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 119/235] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:16.938096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:16.938988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:16.939473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:16.957857 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:16.959415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:17.034511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 117/236] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:17.058674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ea9ef-d525-468e-b881-3464d7a7588b None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:17.172897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408ea9ef-d525-468e-b881-3464d7a7588b None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:17.212650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc7f6e9-fd60-4657-8b92-60db68ddd0e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:17.213395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f6e9-fd60-4657-8b92-60db68ddd0e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.213692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f6e9-fd60-4657-8b92-60db68ddd0e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.213975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc7f6e9-fd60-4657-8b92-60db68ddd0e8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.227150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc7f6e9-fd60-4657-8b92-60db68ddd0e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ccc7f6e9-fd60-4657-8b92-60db68ddd0e8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:17.235223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:17.236197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:17.236994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 120/237] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:17.243152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:17.272036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414b08-1acc-487b-9535-6405cddd979c None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.272332 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414b08-1acc-487b-9535-6405cddd979c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.272604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca414b08-1acc-487b-9535-6405cddd979c None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.274146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 121/238] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:17.280901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.281129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.281285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.309620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:17.313182 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:17.314413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:17.357059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d391b-92c3-47a3-b54c-b91cc587543a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:17.394850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:17.395978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.396505 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.396988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.397953 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:17.398463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:17.400075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:17.409616 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 118/239] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:17.417652 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:17.421892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:17.467896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 122/240] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:17.540853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:17.570878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8bcf43-aa16-4d4c-a52e-7021559f7f33 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:17.586992 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:17.617912 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:17.619449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.620046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.620909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] PATH_INFO: `/v3/users/cbdc37053d8a4e72a84981f28ab44f72` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.641418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] RBAC: Authorizing `identity:get_user(user_id=cbdc37053d8a4e72a84981f28ab44f72)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:17.644504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:17.648214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 119/241] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:17 2022] GET /identity/v3/users/cbdc37053d8a4e72a84981f28ab44f72 => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:17.657114 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:17.773292 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56851e9a-d898-495e-bede-33ade573ff7e None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:17.783216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931a4674-b880-4cbb-ba08-e68f100a8fe1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:17.825258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf5c0a8-7440-4b1c-ba69-b207e346be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:17.826290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5c0a8-7440-4b1c-ba69-b207e346be9f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.826801 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5c0a8-7440-4b1c-ba69-b207e346be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.827278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf5c0a8-7440-4b1c-ba69-b207e346be9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.851106 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:17.851965 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:17.852250 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:17.852530 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:17.856527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:17.858073 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:17.860112 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 123/242] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:17.865633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:17.876119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:17.918587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5c0a8-7440-4b1c-ba69-b207e346be9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:17.920744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf5c0a8-7440-4b1c-ba69-b207e346be9f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:17.990600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:18.053330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 120/243] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:18.063795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cee84f-face-40a7-a10a-889cd6aa259c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.063795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cee84f-face-40a7-a10a-889cd6aa259c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.063795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cee84f-face-40a7-a10a-889cd6aa259c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.063795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 121/244] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:18.063795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cee84f-face-40a7-a10a-889cd6aa259c None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:18.097323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324f56b7-b9ac-46c9-8f1e-90f968646240 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:18.146745 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8876c5bb-18c2-4f3b-b24f-dc0a32a28c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:18.148382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876c5bb-18c2-4f3b-b24f-dc0a32a28c87 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.149983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876c5bb-18c2-4f3b-b24f-dc0a32a28c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.151024 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8876c5bb-18c2-4f3b-b24f-dc0a32a28c87 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.152379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876c5bb-18c2-4f3b-b24f-dc0a32a28c87 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:18.154822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8876c5bb-18c2-4f3b-b24f-dc0a32a28c87 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:18.183657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 124/245] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:17 2022] POST /identity/v3/users => generated 293 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:18.185098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.185641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.185641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.192816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:18.213019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:18.214259 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:18.239643 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cee84f-face-40a7-a10a-889cd6aa259c None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:18.293368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:18.294733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.295430 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.295955 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.297852 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:18.299882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:18.301976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 122/246] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:18 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:18.308800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:18.407539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 125/247] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:18.431101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4c30cd-d487-4e75-8a21-c715275122c9 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:18.447908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:18.474540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:18.475613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.476160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.476460 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.477309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] RBAC: Adding query filter params (role.id=26adb17a84ba4c37b3b2020394d64a4a, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=cbdc37053d8a4e72a84981f28ab44f72) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:18.477633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:18.479888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:18.486424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 123/248] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:18 2022] GET /identity/v3/role_assignments?user.id=cbdc37053d8a4e72a84981f28ab44f72&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=26adb17a84ba4c37b3b2020394d64a4a => generated 259 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:18.530593 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:18.616637 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fefa8ae-6df9-4ced-a895-ae50aa4da6d7 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:18.670445 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:18.671272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.671563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.671885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.685790 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:18.693797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:18.694675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:18.695462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 126/249] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:18.701884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:18.705379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:18.827913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedcc81-c654-479f-bd19-4e64ab0bfd2c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:18.866071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:18.866812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:18.867042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:18.867319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:18.868099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:18.868405 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:18.869978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:18.879787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 124/250] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:18.885888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:19.027542 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:19.036804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b08dc72-361e-49a9-baa1-bf8a08168573 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:19.095605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca01be9-2285-4df8-9eec-0610ff371631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:19.097263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01be9-2285-4df8-9eec-0610ff371631 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.098253 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01be9-2285-4df8-9eec-0610ff371631 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.098744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca01be9-2285-4df8-9eec-0610ff371631 None admin] PATH_INFO: `/v3/users/ad495619c5cb440dbba915c8f3ef99fd` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.101107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01be9-2285-4df8-9eec-0610ff371631 None admin] RBAC: Authorizing `identity:get_user(user_id=ad495619c5cb440dbba915c8f3ef99fd)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:19.104154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca01be9-2285-4df8-9eec-0610ff371631 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:19.111941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 127/251] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:18 2022] GET /identity/v3/users/ad495619c5cb440dbba915c8f3ef99fd => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:19.114890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:19.182395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd4a1-b637-47a8-981d-5eb370578aa8 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.182994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd4a1-b637-47a8-981d-5eb370578aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.183513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16bbd4a1-b637-47a8-981d-5eb370578aa8 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.185409 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 128/252] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:19.196616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89b08b-0106-427f-bcae-788390757729 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.197234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89b08b-0106-427f-bcae-788390757729 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.197762 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f89b08b-0106-427f-bcae-788390757729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.223114 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:19.226259 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5f89b08b-0106-427f-bcae-788390757729 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:19.232364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5f89b08b-0106-427f-bcae-788390757729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:19.320292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8073f571-f6a7-4be9-9b6a-b7ada6a99108 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:19.324944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 129/253] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:19.352489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89b08b-0106-427f-bcae-788390757729 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:19.417146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:19.418321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.418614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.418885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.421452 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:19.423000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:19.424960 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 125/254] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:19 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:19.432731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:19.603258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6c3fa7-109e-4942-ac48-e94b01ad3e52 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:19.617183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:19.627015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f89b08b-0106-427f-bcae-788390757729 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:19.635401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:19.647791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74912016-4c8e-4044-8751-58bd0aae8b18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:19.647791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74912016-4c8e-4044-8751-58bd0aae8b18 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.647791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74912016-4c8e-4044-8751-58bd0aae8b18 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.647791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74912016-4c8e-4044-8751-58bd0aae8b18 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed/users/ad495619c5cb440dbba915c8f3ef99fd/roles/ab8f66c9c17141c78f03d685bacac0dd` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.648180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74912016-4c8e-4044-8751-58bd0aae8b18 None admin] RBAC: Authorizing `identity:create_grant(project_id=9304cc0bba194ff5bca330be4184efed, user_id=ad495619c5cb440dbba915c8f3ef99fd, role_id=ab8f66c9c17141c78f03d685bacac0dd)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:19.648180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74912016-4c8e-4044-8751-58bd0aae8b18 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:19.668433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 126/255] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:19 2022] PUT /identity/v3/projects/9304cc0bba194ff5bca330be4184efed/users/ad495619c5cb440dbba915c8f3ef99fd/roles/ab8f66c9c17141c78f03d685bacac0dd => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:13:19.671212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed28fa-f8ca-48ae-9212-2accc097ae8a None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.671503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed28fa-f8ca-48ae-9212-2accc097ae8a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.671809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbed28fa-f8ca-48ae-9212-2accc097ae8a None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.673506 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 127/256] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:19.681652 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.682002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.682291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.713936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:19.715545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:19.716394 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:19.716679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:19.716960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:19.718370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:19.742065 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:19.766153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:19.767125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:19.768079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:19.771822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 130/257] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 420 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:19.794465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:19.921704 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 128/258] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:19.949362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c8f96c-f4ea-4ac8-b51f-6767df9d3440 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.013009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.023356 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:20.024082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:20.024369 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:20.024649 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:20.025412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:20.025724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:20.031468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:20.057266 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 131/259] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:20.064461 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.107543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:20.186888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760bd91b-1a7b-419a-8e54-2c70bcaa8368 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.229448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:20.231021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9023d73-80fd-4aac-af44-df8ad54c4420 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.257275 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:20.258171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:20.258461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:20.258734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:20.275843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:20.281298 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:20.282191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:20.282475 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:20.282750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] PATH_INFO: `/v3/users/83e452c03fcc4304b0a0eb7c18e61793` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:20.295079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:20.296051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:20.296924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:20.297541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] RBAC: Authorizing `identity:get_user(user_id=83e452c03fcc4304b0a0eb7c18e61793)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:20.297620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 129/260] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:20.298186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:20.299826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 132/261] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/users/83e452c03fcc4304b0a0eb7c18e61793 => generated 283 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:20.305428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.305639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.414321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5060a361-f57b-4478-8cc7-119a52e657bc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.455824 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:20.460919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:20.461819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:20.462234 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:20.462629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:20.468191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:20.468589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:20.470057 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:20.472618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298c0535-3ead-4d84-995f-9ec75429ee54 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.482874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 130/262] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:20.505885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.523290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:20.524261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:20.524686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:20.525121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:20.557097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:20.620051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:20.620672 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115b0075-460b-45b4-a78b-a9cacd8d6e84 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.621620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:20.657176 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:20.658345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:20.658773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:20.659192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] PATH_INFO: `/v3/users/83e452c03fcc4304b0a0eb7c18e61793` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:20.660632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] RBAC: Authorizing `identity:get_user(user_id=83e452c03fcc4304b0a0eb7c18e61793)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:20.662233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:20.664518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 131/263] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/users/83e452c03fcc4304b0a0eb7c18e61793 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:20.686126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.720021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:20.735123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 133/264] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:13:20.742103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:20.930557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c23a52-2e40-4f0c-be46-0eeb40cb42b0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.936108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0ed7c9-ad03-4de4-8330-7ab872479326 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:20.957612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:21.005411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0d4f7-ceb7-4646-9380-541c30435eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:21.005993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d4f7-ceb7-4646-9380-541c30435eff None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.006278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d4f7-ceb7-4646-9380-541c30435eff None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.006654 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0d4f7-ceb7-4646-9380-541c30435eff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.017579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:21.018561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.018891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.019172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.020408 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:21.021883 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:21.024052 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 134/265] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:21.029633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:21.108160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:21.165893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2b00e5-5135-4915-bca3-ea124870ffca None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:21.178489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0d4f7-ceb7-4646-9380-541c30435eff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:21.180001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0d4f7-ceb7-4646-9380-541c30435eff None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:21.203698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:21.204582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.204934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.205282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.206709 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=83e452c03fcc4304b0a0eb7c18e61793) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:21.207105 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:21.208671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:21.216204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 135/266] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:21 2022] GET /identity/v3/role_assignments?user.id=83e452c03fcc4304b0a0eb7c18e61793&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:21.378424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 132/267] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:21.384192 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:21.542076 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db6f5d7-b0a4-4b7c-918d-6ac43f6dd09d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:21.548082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4309-21fc-4513-b724-a8570d55589a None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.548701 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4309-21fc-4513-b724-a8570d55589a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.549197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ce4309-21fc-4513-b724-a8570d55589a None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.551147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 133/268] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:21.557124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.557751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.558297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.572236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:21.591399 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:21.592304 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.592584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.592859 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.594283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:21.595508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:21.596567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:21.598106 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:21.600301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 136/269] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:21 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:21.608225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:21.620569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:21.699975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 134/270] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:21.741080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:21.743705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b608c3a-0991-4cf1-a848-8fd5cf102692 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:21.786585 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:21.787539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.787856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.788201 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.788976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] RBAC: Adding query filter params (role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=83e452c03fcc4304b0a0eb7c18e61793) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:21.789293 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:21.790760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:21.806878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 137/271] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:21 2022] GET /identity/v3/role_assignments?user.id=83e452c03fcc4304b0a0eb7c18e61793&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=482894a175b245f6b17bc1592bbbc982 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:21.920459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5bb802-6f1e-4228-90d5-050875e7cc48 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:21.972193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fb393d-fd94-495b-a066-9a34b32af7de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:21.972948 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb393d-fd94-495b-a066-9a34b32af7de None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:21.973233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb393d-fd94-495b-a066-9a34b32af7de None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:21.973510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fb393d-fd94-495b-a066-9a34b32af7de None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:21.992661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fb393d-fd94-495b-a066-9a34b32af7de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-e4fb393d-fd94-495b-a066-9a34b32af7de None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:22.000718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:22.001640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:22.002424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 135/272] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:22.009326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.019200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06642cd-25e4-4213-a6f6-6122eb4a3533 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.019529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06642cd-25e4-4213-a6f6-6122eb4a3533 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.019806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06642cd-25e4-4213-a6f6-6122eb4a3533 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.021236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 136/273] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:22.028289 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.028695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.028978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.038541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.064478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:22.066286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:22.084154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.145144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ad5ef6-378c-40e8-b13b-5cc718e12823 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.159145 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 137/274] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:22.194288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.202829 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.203585 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.203943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.204273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.205041 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:22.205348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.206855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.216997 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 138/275] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:22.226206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.324160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ed0e7-b8c3-46bd-b670-3a4ee34276e4 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.340797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa955aa-74fb-451f-bf1c-5ac025063335 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.357195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.359438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.367455 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.368413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.368692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.369142 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.379470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db83c-f02f-4246-b0f9-25c5e3d9501d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.379712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:22.380381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db83c-f02f-4246-b0f9-25c5e3d9501d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.380666 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db83c-f02f-4246-b0f9-25c5e3d9501d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.380946 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db83c-f02f-4246-b0f9-25c5e3d9501d None admin] PATH_INFO: `/v3/users/cbdc37053d8a4e72a84981f28ab44f72` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.382136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7db83c-f02f-4246-b0f9-25c5e3d9501d None admin] RBAC: Authorizing `identity:get_user(user_id=cbdc37053d8a4e72a84981f28ab44f72)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.383599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7db83c-f02f-4246-b0f9-25c5e3d9501d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.385517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 139/276] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/users/cbdc37053d8a4e72a84981f28ab44f72 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:22.387187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbe6a-703c-4b49-aa76-1d3c6a094758 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.387478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbe6a-703c-4b49-aa76-1d3c6a094758 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.387785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbcbe6a-703c-4b49-aa76-1d3c6a094758 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.389415 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 140/277] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:22.390495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:22.391359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:22.392204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 138/278] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:22.394692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.394977 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.395832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.396545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.413936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:22.415118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:22.491849 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 141/279] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:22.491849 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.523615 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc4244-80a0-40dc-a880-80ce80ddeb70 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.561422 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.562212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.562497 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.562775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.564005 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.565472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.567257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 139/280] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:22.568053 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.603473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12454ea6-504b-4989-85c3-f39acc4df620 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.618403 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.633178 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.643580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.644416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.644698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.645066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.645816 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:22.646121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.647496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.657064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 142/281] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:22.657695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.681781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c2cc18-8d17-46a5-a4da-8c562ce66469 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.718494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.719292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.719579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.719889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.721081 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.723096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.724773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 140/282] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:22.725537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.773209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9966a-149d-409d-a2c4-7695fa281c0b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.809897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.811134 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.811587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.812143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed/users/cbdc37053d8a4e72a84981f28ab44f72/roles/26adb17a84ba4c37b3b2020394d64a4a` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.814392 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=9304cc0bba194ff5bca330be4184efed, user_id=cbdc37053d8a4e72a84981f28ab44f72, role_id=26adb17a84ba4c37b3b2020394d64a4a)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.816426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.829670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 143/283] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:13:22 2022] PUT /identity/v3/projects/9304cc0bba194ff5bca330be4184efed/users/cbdc37053d8a4e72a84981f28ab44f72/roles/26adb17a84ba4c37b3b2020394d64a4a => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:22.830459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.843853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aaa641-a0f6-4124-8528-397ea82559ff None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:22.877231 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.890906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:22.905113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:22.907075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:22.907643 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:22.908352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] PATH_INFO: `/v3/users/c4d9f7af33af4fbab18cb7b6a51f4e50` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:22.931693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] RBAC: Authorizing `identity:get_user(user_id=c4d9f7af33af4fbab18cb7b6a51f4e50)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:22.933528 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:22.935889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 141/284] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/users/c4d9f7af33af4fbab18cb7b6a51f4e50 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:22.941674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:22.968939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4594310e-5522-4f49-a47d-fb66879a22f3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:23.011140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94abeb67-655d-49d2-b295-828a8de91af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:23.011888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb67-655d-49d2-b295-828a8de91af0 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.012172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb67-655d-49d2-b295-828a8de91af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.012462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94abeb67-655d-49d2-b295-828a8de91af0 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.013213 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abeb67-655d-49d2-b295-828a8de91af0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:23.014732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94abeb67-655d-49d2-b295-828a8de91af0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:23.040892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 144/285] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:22 2022] POST /identity/v3/users => generated 293 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:23.075663 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50463e-2192-49fb-b3a1-dd252a40d10e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.076257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50463e-2192-49fb-b3a1-dd252a40d10e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.076690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b50463e-2192-49fb-b3a1-dd252a40d10e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.078856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 145/286] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:23.081929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe99ec-64ca-44d2-b541-4e94fe72128a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:23.084966 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.085527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.086077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.105001 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:23.106628 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:23.120059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:23.120770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.121043 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.121320 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.122360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, user.id=c4d9f7af33af4fbab18cb7b6a51f4e50, scope.system=all) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:23.122680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:23.124228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:23.131212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 142/287] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 17 07:13:22 2022] GET /identity/v3/role_assignments?user.id=c4d9f7af33af4fbab18cb7b6a51f4e50&scope.system=all&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:23.211881 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 146/288] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:23.235731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:23.295179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:23.358605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8097ef-a6b3-430c-ba02-c585203828f3 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:23.400215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:23.401691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.402129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.402552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.414012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:23.422343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:23.423473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:23.424525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:23.427515 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 143/289] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:23.433183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:23.460116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:23.549744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4477fee-4e5e-4720-8e4e-f54bb1bc504f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:23.588433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:23.589473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.589966 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.590538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.591496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:23.592037 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:23.593662 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:23.603194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 147/290] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:23.608999 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:23.747668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfe6c4-ab29-4d1d-a1fc-ec131ea226c7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:23.759130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:23.783680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:23.784636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.784916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.785197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] PATH_INFO: `/v3/users/ad495619c5cb440dbba915c8f3ef99fd` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:23.786391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] RBAC: Authorizing `identity:get_user(user_id=ad495619c5cb440dbba915c8f3ef99fd)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:23.791796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:23.791796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 144/291] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:23 2022] GET /identity/v3/users/ad495619c5cb440dbba915c8f3ef99fd => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:23.796766 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:23.907416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:23.928730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e488896-3b45-4176-90ed-deab1ddf58f1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:23.962828 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:23.963538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:23.963851 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:23.964178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:24.055914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:24.057430 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:24.169411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:24.190357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 148/292] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:24.195909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:24.386655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57414ee0-d2a9-46ad-b3e1-0ebc00cf4e8a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:24.434885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46da1a0e-0d76-43a9-81e4-e0597a3e1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:24.436546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1a0e-0d76-43a9-81e4-e0597a3e1a32 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:24.437039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1a0e-0d76-43a9-81e4-e0597a3e1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:24.437551 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46da1a0e-0d76-43a9-81e4-e0597a3e1a32 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:24.438990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1a0e-0d76-43a9-81e4-e0597a3e1a32 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:24.441219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46da1a0e-0d76-43a9-81e4-e0597a3e1a32 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:24.443130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 145/293] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:24 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:24.452874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:24.611814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee2bb11-2208-4e84-b7a2-6bddcfc1c23a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:24.658053 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:24.658719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:24.659004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:24.659835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:24.660820 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=ad495619c5cb440dbba915c8f3ef99fd) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:24.661232 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:24.663083 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-541ceee3-fee9-4a9e-8c24-e247f02a769a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:24.673599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 149/294] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:24 2022] GET /identity/v3/role_assignments?user.id=ad495619c5cb440dbba915c8f3ef99fd&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:25.472781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483f197-0501-4c83-87b9-e21d3ec04704 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.473295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483f197-0501-4c83-87b9-e21d3ec04704 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.473295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2483f197-0501-4c83-87b9-e21d3ec04704 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.474933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 146/295] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:25.480189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f350140-fa76-49d0-b135-a39c678e2ef5 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.481083 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f350140-fa76-49d0-b135-a39c678e2ef5 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.481562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f350140-fa76-49d0-b135-a39c678e2ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.499118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-3f350140-fa76-49d0-b135-a39c678e2ef5 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:25.500640 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-3f350140-fa76-49d0-b135-a39c678e2ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:25.544783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:25.570773 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 150/296] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:25.593741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483f197-0501-4c83-87b9-e21d3ec04704 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:25.653404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:25.724642 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e146d-5303-4db5-a3ee-86516d51426e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.725269 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e146d-5303-4db5-a3ee-86516d51426e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.725777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402e146d-5303-4db5-a3ee-86516d51426e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.727577 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 151/297] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:25.727691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2483f197-0501-4c83-87b9-e21d3ec04704 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:25.733604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44326d-c5e3-4578-a33f-d47022cf7c66 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.734206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44326d-c5e3-4578-a33f-d47022cf7c66 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.734691 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e44326d-c5e3-4578-a33f-d47022cf7c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.753536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-1e44326d-c5e3-4578-a33f-d47022cf7c66 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:25.755158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-1e44326d-c5e3-4578-a33f-d47022cf7c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:25.766893 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7870c903-e7c4-4c1c-a280-32ace229b79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:25.767736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c903-e7c4-4c1c-a280-32ace229b79a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.768255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c903-e7c4-4c1c-a280-32ace229b79a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.768484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7870c903-e7c4-4c1c-a280-32ace229b79a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.779658 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7870c903-e7c4-4c1c-a280-32ace229b79a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-7870c903-e7c4-4c1c-a280-32ace229b79a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:25.787747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:25.788655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:25.789424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 147/298] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:25.790204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632a08d-02fd-4df6-aac4-f8a197803a87 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.790632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632a08d-02fd-4df6-aac4-f8a197803a87 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.791069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d632a08d-02fd-4df6-aac4-f8a197803a87 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.792831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 148/299] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:25.796075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632a08d-02fd-4df6-aac4-f8a197803a87 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:25.833797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 152/300] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:25.834978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.835272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.835547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.851936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:25.853339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:25.926295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d632a08d-02fd-4df6-aac4-f8a197803a87 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:25.926505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 153/301] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:25.928764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:25.935828 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:25.966809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:25.967507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:25.967819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:25.968105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:25.968861 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:25.969174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:25.970549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:25.972387 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:25.983796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 149/302] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:25.983796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.048923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f678c7d4-5313-4040-9fa9-a1666cdd4e3d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.090589 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.091396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.091655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923faf8d-1236-4aad-9cac-f530bbb10e81 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.091756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.092001 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.102875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:26.110690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:26.111580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 154/303] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:26.118176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.129301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41bdaa0-7294-4098-818d-f52e9fc81491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.130113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bdaa0-7294-4098-818d-f52e9fc81491 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.130406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bdaa0-7294-4098-818d-f52e9fc81491 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.130778 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41bdaa0-7294-4098-818d-f52e9fc81491 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.141108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41bdaa0-7294-4098-818d-f52e9fc81491 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f41bdaa0-7294-4098-818d-f52e9fc81491 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:26.148851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:26.149788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 150/304] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:26.155735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065229d-7e83-4b0d-9f9f-ab7b85f37e3c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.156608 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065229d-7e83-4b0d-9f9f-ab7b85f37e3c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.156608 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065229d-7e83-4b0d-9f9f-ab7b85f37e3c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.158029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 151/305] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:26.158891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065229d-7e83-4b0d-9f9f-ab7b85f37e3c None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.193226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.215130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.221334 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3ffb81-44d3-4e8f-a7fd-5dd6a4bcfd04 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.255316 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.256144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.256432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.256715 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] PATH_INFO: `/v3/users/cbdc37053d8a4e72a84981f28ab44f72` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.257906 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] RBAC: Authorizing `identity:get_user(user_id=cbdc37053d8a4e72a84981f28ab44f72)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.259356 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.261108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 155/306] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/users/cbdc37053d8a4e72a84981f28ab44f72 => generated 297 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:26.267465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.274861 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065229d-7e83-4b0d-9f9f-ab7b85f37e3c None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.309392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.310058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.310345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.310629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.311370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:26.311680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.313090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cff329-6682-4c7b-b845-93bd604d908a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.320964 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 152/307] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:26.322124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.322419 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.322826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.341853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:26.343048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:26.368633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f16ec72-1e07-4f83-92ac-f219c179b8e9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.401176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.401852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.402153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.402560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.403379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:26.403823 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.405481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.411848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 153/308] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:26.412871 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.415902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 156/309] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:26.416597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.439792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.450033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.516720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033541a-1b64-4a16-a184-7c6566c94707 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.523264 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534c46f6-51dd-4c5d-8d8b-a9f5de303db1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.551794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.552450 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.552738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.553016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.556686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.558026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.558343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.558621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] PATH_INFO: `/v3/users/c4d9f7af33af4fbab18cb7b6a51f4e50` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.559861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d9f7af33af4fbab18cb7b6a51f4e50)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.561329 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.562957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 157/310] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/users/c4d9f7af33af4fbab18cb7b6a51f4e50 => generated 293 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:26.563712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.626047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.627516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.648175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.660071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.668100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd293e3c-2997-4381-bad7-a7d8b8cf10f1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.702343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.703279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.703940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.703940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] PATH_INFO: `/v3/users/0885aa8faf7b40e4aa1562bd275c4787` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.717629 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] RBAC: Authorizing `identity:get_user(user_id=0885aa8faf7b40e4aa1562bd275c4787)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.719115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.721105 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 158/311] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/users/0885aa8faf7b40e4aa1562bd275c4787 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:26.722249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.731651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 154/312] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:26.732802 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.828758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c663cfb-d53c-44b9-9513-032e19b5b7c4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.839377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9283735-8290-4522-aa2f-d1a612b4c255 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:26.859631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.866305 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.867095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.867379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.867658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.868840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.870544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.872498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 159/313] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:26.873261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.879942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:26.880823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:26.881109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:26.881388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] PATH_INFO: `/v3/system/users/c4d9f7af33af4fbab18cb7b6a51f4e50/roles/ab8f66c9c17141c78f03d685bacac0dd` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:26.882911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=c4d9f7af33af4fbab18cb7b6a51f4e50, role_id=ab8f66c9c17141c78f03d685bacac0dd)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:26.884341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:26.893720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 155/314] 10.222.0.58 () {58 vars in 1334 bytes} [Fri Jun 17 07:13:26 2022] PUT /identity/v3/system/users/c4d9f7af33af4fbab18cb7b6a51f4e50/roles/ab8f66c9c17141c78f03d685bacac0dd => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:26.894575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:26.900954 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:26.996814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0acc574-7d68-47ae-8266-5b74156e85dd None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:27.017601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddad90b-6189-4289-8b35-ea99e28d386f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:27.034850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:27.035824 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:27.036251 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:27.036674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:27.037681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] RBAC: Adding query filter params (role.id=26adb17a84ba4c37b3b2020394d64a4a, user.id=0885aa8faf7b40e4aa1562bd275c4787, scope.system=all) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:27.038144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:27.039988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:27.046975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 160/315] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/role_assignments?user.id=0885aa8faf7b40e4aa1562bd275c4787&scope.system=all&role.id=26adb17a84ba4c37b3b2020394d64a4a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:27.048221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:27.069438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:27.069438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:27.069438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:27.069438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:27.070775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:27.072562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:27.074758 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 156/316] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:26 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:27.081602 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:27.168931 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:27.193787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e27475e-8cde-42f3-a56f-8f810853641b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:27.204161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:27.225489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e60af5d-94c1-42e3-9a86-99de5fc1d70a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:27.245574 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fbd032-80e5-40a2-9840-f01de25fdb7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:27.247060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbd032-80e5-40a2-9840-f01de25fdb7a None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:27.247433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbd032-80e5-40a2-9840-f01de25fdb7a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:27.247738 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fbd032-80e5-40a2-9840-f01de25fdb7a None admin] PATH_INFO: `/v3/groups` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:27.248888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbd032-80e5-40a2-9840-f01de25fdb7a None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:27.251644 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fbd032-80e5-40a2-9840-f01de25fdb7a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:27.274809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:27.275493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:27.275856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:27.276171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:27.277032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] RBAC: Adding query filter params (role.id=26adb17a84ba4c37b3b2020394d64a4a, scope.project.id=9304cc0bba194ff5bca330be4184efed, user.id=cbdc37053d8a4e72a84981f28ab44f72) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:27.277218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 161/317] 10.222.0.58 () {60 vars in 1134 bytes} [Fri Jun 17 07:13:27 2022] POST /identity/v3/groups => generated 229 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:27.277383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:27.278961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bb7f1c-844c-42f2-a223-1accfde43482 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:27.306869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 157/318] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:27 2022] GET /identity/v3/role_assignments?user.id=cbdc37053d8a4e72a84981f28ab44f72&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=26adb17a84ba4c37b3b2020394d64a4a => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:29.158492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc6d2-74bd-4aae-81c6-b936a834f42f None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.159739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc6d2-74bd-4aae-81c6-b936a834f42f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.159739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9bc6d2-74bd-4aae-81c6-b936a834f42f None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.161122 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 162/319] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:29.168181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af58b82-9647-4a9f-bd0e-d0ee1d52e5fc None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.168811 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af58b82-9647-4a9f-bd0e-d0ee1d52e5fc None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.169105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af58b82-9647-4a9f-bd0e-d0ee1d52e5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.197348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-0af58b82-9647-4a9f-bd0e-d0ee1d52e5fc None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:29.199345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-0af58b82-9647-4a9f-bd0e-d0ee1d52e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:29.297484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 158/320] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:29.322068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc6d2-74bd-4aae-81c6-b936a834f42f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:29.464129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9bc6d2-74bd-4aae-81c6-b936a834f42f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:29.474738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119157-7daf-412c-8b9d-ff9502c4de32 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.475439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119157-7daf-412c-8b9d-ff9502c4de32 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.475439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a119157-7daf-412c-8b9d-ff9502c4de32 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.477041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 159/321] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:29.482827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58013-d1f7-4723-8ce5-a7fdb4471860 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.483179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58013-d1f7-4723-8ce5-a7fdb4471860 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.483420 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf58013-d1f7-4723-8ce5-a7fdb4471860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.502234 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-9bf58013-d1f7-4723-8ce5-a7fdb4471860 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:29.503674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-9bf58013-d1f7-4723-8ce5-a7fdb4471860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:29.516179 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:29.517840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.518845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.519403 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.535404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:29.543756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:29.544744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:29.545686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:29.548265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 163/322] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:29.555896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:29.562411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:29.569306 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:29.607417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 160/323] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:29.624238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9bebd-e1a7-4889-bdb2-83e00ed84785 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.624943 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9bebd-e1a7-4889-bdb2-83e00ed84785 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.625234 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed9bebd-e1a7-4889-bdb2-83e00ed84785 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.627095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 161/324] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:29.630438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9bebd-e1a7-4889-bdb2-83e00ed84785 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:29.708728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925cc163-79f8-4ee9-bb16-2179c98bb777 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:29.746929 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:29.747522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.747920 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.748262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.749025 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:29.749330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:29.751160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3307e9fc-d59a-4a4c-a8ce-48f84be1537c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:29.763567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 164/325] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:29.764943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.765285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.765623 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.770999 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed9bebd-e1a7-4889-bdb2-83e00ed84785 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:29.787671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:29.788934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:29.822047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:29.823136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:29.823511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:29.824073 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:29.838528 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:29.846963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:29.848122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 162/326] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:29.849191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:29.867024 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:29.876615 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 165/327] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:29.884142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:29.888554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:29.981524 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6fdf453-c978-498e-accf-9085e6509232 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.016499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360c8dc6-1ca0-4438-990f-5413b7742ce3 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.026243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.027673 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.028197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.028684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] PATH_INFO: `/v3/users/c4d9f7af33af4fbab18cb7b6a51f4e50` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.031068 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=c4d9f7af33af4fbab18cb7b6a51f4e50)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.033794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.044010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 163/328] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:29 2022] GET /identity/v3/users/c4d9f7af33af4fbab18cb7b6a51f4e50 => generated 293 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:30.044010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:30.064433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.065147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.065510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.065705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.066492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:30.066853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.068346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.077858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 166/329] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:30.078690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:30.157582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:30.172909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b664ef-489f-48c8-9e81-de20b6c8d5d9 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.177147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:30.207964 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ca0c9b-9fe8-47b5-918a-ab347aff6704 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.216777 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.217672 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.217960 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.218235 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.219523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.222061 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.224070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 164/330] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:30.225185 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:30.261035 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.261714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.261998 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.262284 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.263184 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] RBAC: Adding query filter params (role.id=ab8f66c9c17141c78f03d685bacac0dd, user.id=c4d9f7af33af4fbab18cb7b6a51f4e50, scope.system=all) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:30.263512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.265031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.282381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 167/331] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 17 07:13:30 2022] GET /identity/v3/role_assignments?user.id=c4d9f7af33af4fbab18cb7b6a51f4e50&scope.system=all&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 510 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:30.283218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:30.371160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf03c96-c4a2-409d-b5cf-96eb9a462f6c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.418894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.419837 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.420124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.420431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] PATH_INFO: `/v3/users/0885aa8faf7b40e4aa1562bd275c4787` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.422625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] RBAC: Authorizing `identity:get_user(user_id=0885aa8faf7b40e4aa1562bd275c4787)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.425736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.428605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 165/332] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:30 2022] GET /identity/v3/users/0885aa8faf7b40e4aa1562bd275c4787 => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:30.433646 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e4f3c1-ee4a-447b-9a55-25141fe9422c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.434910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:30.463988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:30.492055 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d43b6b4-06fb-4b50-8a87-06c42c2ec3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.492740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b6b4-06fb-4b50-8a87-06c42c2ec3f4 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.493040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b6b4-06fb-4b50-8a87-06c42c2ec3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.493315 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d43b6b4-06fb-4b50-8a87-06c42c2ec3f4 None admin] PATH_INFO: `/v3/groups` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.495803 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b6b4-06fb-4b50-8a87-06c42c2ec3f4 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.495803 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d43b6b4-06fb-4b50-8a87-06c42c2ec3f4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.497079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:30.519409 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 168/333] 10.222.0.58 () {60 vars in 1134 bytes} [Fri Jun 17 07:13:30 2022] POST /identity/v3/groups => generated 226 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:30.584367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c132932-b24a-4d98-aeb0-d2926c1d9d47 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:30.622139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e76fed-3eb2-42bf-8999-095675883dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:30.623030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76fed-3eb2-42bf-8999-095675883dea None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:30.623313 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76fed-3eb2-42bf-8999-095675883dea None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:30.623590 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e76fed-3eb2-42bf-8999-095675883dea None admin] PATH_INFO: `/v3/system/users/0885aa8faf7b40e4aa1562bd275c4787/roles/26adb17a84ba4c37b3b2020394d64a4a` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:30.625137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76fed-3eb2-42bf-8999-095675883dea None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0885aa8faf7b40e4aa1562bd275c4787, role_id=26adb17a84ba4c37b3b2020394d64a4a)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:30.626542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e76fed-3eb2-42bf-8999-095675883dea None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:30.635791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 166/334] 10.222.0.58 () {58 vars in 1334 bytes} [Fri Jun 17 07:13:30 2022] PUT /identity/v3/system/users/0885aa8faf7b40e4aa1562bd275c4787/roles/26adb17a84ba4c37b3b2020394d64a4a => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:33.527609 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319977-b347-4a27-a98a-57754fafc6f1 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.528198 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319977-b347-4a27-a98a-57754fafc6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.528198 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0319977-b347-4a27-a98a-57754fafc6f1 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.530068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 169/335] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:33.536526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549515fc-b5ce-450b-bfc5-8be3becb7b2e None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.537080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549515fc-b5ce-450b-bfc5-8be3becb7b2e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.537080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549515fc-b5ce-450b-bfc5-8be3becb7b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.559187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-549515fc-b5ce-450b-bfc5-8be3becb7b2e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:33.560433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-549515fc-b5ce-450b-bfc5-8be3becb7b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:33.600328 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc8e-8e1a-4b96-b397-64e021bc0e09 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.600645 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc8e-8e1a-4b96-b397-64e021bc0e09 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.600890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8adfc8e-8e1a-4b96-b397-64e021bc0e09 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.602454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 170/336] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:33.607645 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.608235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.608725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.644856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:33.646419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:33.671787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 167/337] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:33.671787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a48a5-7102-4111-96fc-d889f3db5dc3 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.671787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a48a5-7102-4111-96fc-d889f3db5dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.671787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02a48a5-7102-4111-96fc-d889f3db5dc3 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.671787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 168/338] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:33.678645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.678932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.679219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.705012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:33.706290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:33.745849 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:33.783018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 169/339] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:33.784387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:33.797481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 171/340] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:33.835938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:33.905330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a176ad44-0139-4199-aa22-a4d29e24c818 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:33.953757 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:33.954588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:33.954877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:33.955163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:33.980186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:33.998054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:34.000319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:34.001144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 170/341] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:34.004324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.067544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9876c4b-9180-4e1a-b96e-01c39084f069 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.069595 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:34.082925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:34.128211 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.128511 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.128850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.129202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.145813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:34.161385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:34.162395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:34.163414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:34.167471 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 172/342] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:34.167996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.194509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb5463a-6705-4617-8388-0accc364fa3e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.234862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3bad7a-4a4a-4342-b427-b5c6989dc979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.235975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bad7a-4a4a-4342-b427-b5c6989dc979 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.236413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bad7a-4a4a-4342-b427-b5c6989dc979 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.236868 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3bad7a-4a4a-4342-b427-b5c6989dc979 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.249590 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3bad7a-4a4a-4342-b427-b5c6989dc979 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-4e3bad7a-4a4a-4342-b427-b5c6989dc979 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:34.258096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:34.259049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:34.260015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:34.262533 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 171/343] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:34.264348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c569-c1c6-489b-b402-464d8ba6b9ac None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.264839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c569-c1c6-489b-b402-464d8ba6b9ac None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.265324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e8c569-c1c6-489b-b402-464d8ba6b9ac None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.271954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 172/344] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:34.273188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c569-c1c6-489b-b402-464d8ba6b9ac None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.298868 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b28fd-f345-4548-84c5-f2fef1eab127 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.349653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.350683 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.351164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.351650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.352626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:34.353141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:34.354865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:34.364793 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 173/345] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:34.370466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.413991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:34.416149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:34.443927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e8c569-c1c6-489b-b402-464d8ba6b9ac None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.505261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.506929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.506929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.506929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.507181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:34.507475 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:34.509087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c9c1e9-308a-4570-ac85-d4ae4f4b0371 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:34.521382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 173/346] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:34.522834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.523280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.523572 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.535726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712fd02a-6ead-4830-b5fe-2b85731c7e06 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.551151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:34.552194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:34.579230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.580396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.581522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.582146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.583314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] RBAC: Adding query filter params (name=member) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:34.584027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:34.586070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:34.596452 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 174/347] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:34.597767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.636591 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 174/348] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:34.636591 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.729153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:34.729756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:34.745212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e483d3-92b6-46b9-b4f8-e0c831ac120d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.760292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a36b98-ceb8-4ce4-9644-29e47d113131 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:34.788169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.789522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.790006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.791282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] PATH_INFO: `/v3/users/0885aa8faf7b40e4aa1562bd275c4787` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.792922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] RBAC: Authorizing `identity:get_user(user_id=0885aa8faf7b40e4aa1562bd275c4787)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:34.794608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:34.796810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 175/349] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:13:34 2022] GET /identity/v3/users/0885aa8faf7b40e4aa1562bd275c4787 => generated 293 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:34.800090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:34.810132 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:34.811098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:34.811517 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:34.812987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:34.926828 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:34.926828 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:34.961598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadb2a2a-96ee-422c-8dde-40c0a4d3d989 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.014941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.016505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.017143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.017668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.035664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:35.053695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:35.074509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 175/350] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:35.077198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.127864 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:35.131700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:35.262141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1aef050-9a7e-483e-9119-7544bad3004e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.316583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553614b5-0c16-427e-9fb7-e2f847bfcdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.318669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553614b5-0c16-427e-9fb7-e2f847bfcdcc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.319541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553614b5-0c16-427e-9fb7-e2f847bfcdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.320313 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553614b5-0c16-427e-9fb7-e2f847bfcdcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.325811 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 176/351] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:35.326688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.337256 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553614b5-0c16-427e-9fb7-e2f847bfcdcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-553614b5-0c16-427e-9fb7-e2f847bfcdcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:35.345982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:35.347484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:35.348315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:35.355533 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 176/352] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:35.357749 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87733-a6ac-458f-85ac-42e885911095 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.358411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87733-a6ac-458f-85ac-42e885911095 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.358906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab87733-a6ac-458f-85ac-42e885911095 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.361332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 177/353] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:35.363266 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87733-a6ac-458f-85ac-42e885911095 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.409874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:35.416996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:35.500081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcfc669-3ca6-4dbd-94d2-730359bd9077 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.518545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab87733-a6ac-458f-85ac-42e885911095 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.545174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.545174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.545772 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.545772 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.546343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] RBAC: Adding query filter params (role.id=26adb17a84ba4c37b3b2020394d64a4a, user.id=0885aa8faf7b40e4aa1562bd275c4787, scope.system=all) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:35.546663 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:35.548854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:35.564006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 177/354] 10.222.0.58 () {56 vars in 1308 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/role_assignments?user.id=0885aa8faf7b40e4aa1562bd275c4787&scope.system=all&role.id=26adb17a84ba4c37b3b2020394d64a4a => generated 510 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:35.565273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.570988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.572075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.572364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.572641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.573989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:35.575604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:35.577937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 178/355] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:35.578677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.720417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc5ba98-9be8-4fd8-840a-afc11fc63374 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.721643 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d19b95-cb10-48ab-97a0-9094de98ea58 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.724770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:35.749571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:35.774874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.776329 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.776804 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.777103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89beaaa0-8418-437e-a04c-41c412ab3dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.777419 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.778233 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaaa0-8418-437e-a04c-41c412ab3dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.778523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:35.778756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaaa0-8418-437e-a04c-41c412ab3dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.779140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89beaaa0-8418-437e-a04c-41c412ab3dc0 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.779259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:35.781165 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e3f319-396c-4740-b7ef-2838ada5161e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:35.781780 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaaa0-8418-437e-a04c-41c412ab3dc0 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:35.783271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89beaaa0-8418-437e-a04c-41c412ab3dc0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:35.785659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 178/356] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:35.787041 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.787332 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.787612 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.791628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 179/357] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:35.793321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eef61-20d2-4414-a4bf-b7cfe2bfb5db None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.793808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eef61-20d2-4414-a4bf-b7cfe2bfb5db None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.794088 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0eef61-20d2-4414-a4bf-b7cfe2bfb5db None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:35.795546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 180/358] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:35.796320 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eef61-20d2-4414-a4bf-b7cfe2bfb5db None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.808310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:35.809818 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:35.898371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 179/359] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:35.899057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:35.938439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0eef61-20d2-4414-a4bf-b7cfe2bfb5db None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:35.991045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:35.994543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:35.994543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:35.994543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.005138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:36.006619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:36.008587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 181/360] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:36.013712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.046796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741a4186-0c61-4a4e-9f4a-4cef26afaaf3 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.060733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:36.064061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:36.091591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3168580e-d7e6-40ba-9fd8-406e995df3f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.092314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168580e-d7e6-40ba-9fd8-406e995df3f2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.092601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168580e-d7e6-40ba-9fd8-406e995df3f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.092875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3168580e-d7e6-40ba-9fd8-406e995df3f2 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.094428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168580e-d7e6-40ba-9fd8-406e995df3f2 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:36.098613 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3168580e-d7e6-40ba-9fd8-406e995df3f2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:36.100126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 180/361] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:35 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:36.101655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.101948 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.102228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.124254 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:36.125302 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:36.175784 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcfb352-9686-4437-ade9-a2c457a8ecf6 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.217804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 181/362] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:36.218686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.219312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.220207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.220639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.221097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.329414 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:36.331619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:36.374221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1894393e-03ec-4bc5-ba6f-a3bd8fc19236 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.375365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:36.393793 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:36.423640 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.424556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.424842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.425120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.441534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:36.450801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:36.451744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:36.452746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 182/363] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:36.456768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.468989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 182/364] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:36.469989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.586151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747dddba-eae1-4753-99a3-5edd6c5e6ef3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.605773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2e6c73-404e-4d3c-98a4-b7888c69e401 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.636664 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.637338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.637624 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.637898 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.638747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=9304cc0bba194ff5bca330be4184efed) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:36.639063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:36.641158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:36.647974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 183/365] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 260 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:36.649194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.649790 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:36.658832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.659842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.660297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.660731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.661862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:36.662172 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:36.663849 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:36.673901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 183/366] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:36.673901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.707540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:36.840306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48651b1-d314-4037-9956-d805b645b506 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.854203 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247e9eea-4a52-4f25-b04f-cd88df282bf5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:36.891197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.892611 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.893836 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.893942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:36.894462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.894633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:36.894875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:36.895152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:36.895946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:36.896251 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:36.897623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:36.909348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 184/367] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:36.910278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.912047 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:36.920853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:36.921795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:36.922596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:36.926419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 184/368] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:36.927619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:36.971231 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.044341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c61913f-102e-4032-99a5-51c255830a0e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.060844 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.068899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30718cf3-4527-45f9-846a-11621b079fc6 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.101427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.102826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.103143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.103734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.105949 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.108593 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.108984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.109896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.110385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.110864 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.115785 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 185/369] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:37.115785 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.215647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.217270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.267755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f31a3f8-6782-4c43-8cb7-26e57ac6d536 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.300613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.316345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.317071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.317718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.317718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.318909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:37.318909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.321088 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.333514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 186/370] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:37.334694 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.363737 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.379787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 185/371] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:37.379787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.485500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8478a4ab-5f5b-4d48-b53e-5077d7e0d733 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.513888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eae0c2-11e0-439d-8835-f93e2c58ab02 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.525425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.526540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.526892 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.527241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.528598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.530488 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.536101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 187/372] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:37.537025 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.554467 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.555478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.556009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.556469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.603239 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.628677 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.637009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.638791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.655230 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857b59d-4b88-4541-be7d-b12f1c04262f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.697065 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.699012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.699911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.700602 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.703241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.706718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.710595 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 188/373] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:37.712306 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.753554 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 186/374] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:37.754696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.827910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb90afb-4766-464a-9467-b0f25f8ce3d0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.856279 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.869738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.870931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.872063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.872536 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.876001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:37.876583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.879685 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.895797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:37.896483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 189/375] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=482894a175b245f6b17bc1592bbbc982 => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:37.898432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:37.911814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9058f2c-1b01-4adc-b36b-49bf2d014898 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:37.951881 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:37.954978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:37.954978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:37.954978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:37.956252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:37.958142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:37.960541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 187/376] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:37.968549 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:38.124967 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c188601-b0e6-46aa-a510-7bfd5b829de5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:38.191522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9030610f-63bb-4809-9d98-77c3921f1d28 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:38.202979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:38.204335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:38.204637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:38.204925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] PATH_INFO: `/v3/projects/e81febd8e3c144628e032f30cc71dcf0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:38.208409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] RBAC: Authorizing `identity:get_project(project_id=e81febd8e3c144628e032f30cc71dcf0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:38.210869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:38.213008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 190/377] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/projects/e81febd8e3c144628e032f30cc71dcf0 => generated 344 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:38.219381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:38.264451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:38.265226 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:38.265519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:38.265802 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:38.266775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=9304cc0bba194ff5bca330be4184efed) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:38.267095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:38.269158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:38.284301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 188/378] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:37 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=482894a175b245f6b17bc1592bbbc982 => generated 260 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:38.352147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:38.448245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db963c0-8fe5-4fcf-8cc9-17e213f24856 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:38.496629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68ed694-054d-4cf8-ad47-725c2784fc96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:38.497627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed694-054d-4cf8-ad47-725c2784fc96 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:38.497917 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed694-054d-4cf8-ad47-725c2784fc96 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:38.498198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68ed694-054d-4cf8-ad47-725c2784fc96 None admin] PATH_INFO: `/v3/groups/b85a0f703c2546a5b23b30c5143b5277` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:38.508055 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed694-054d-4cf8-ad47-725c2784fc96 None admin] RBAC: Authorizing `identity:get_group(group_id=b85a0f703c2546a5b23b30c5143b5277)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:38.509582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68ed694-054d-4cf8-ad47-725c2784fc96 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:38.511810 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 191/379] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:38 2022] GET /identity/v3/groups/b85a0f703c2546a5b23b30c5143b5277 => generated 229 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:38.519054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:38.555528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:38.641877 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416d075-c408-4df7-a110-70a145a87f90 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:38.679724 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:38.680440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:38.680728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:38.681023 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:38.681855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] RBAC: Adding query filter params (group.id=b85a0f703c2546a5b23b30c5143b5277, role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=e81febd8e3c144628e032f30cc71dcf0) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:38.682184 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:38.683654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a6d013-3eb5-490c-bbe9-a60a4e634c6f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:38.690297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 189/380] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:38 2022] GET /identity/v3/role_assignments?group.id=b85a0f703c2546a5b23b30c5143b5277&scope.project.id=e81febd8e3c144628e032f30cc71dcf0&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 260 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:39.202059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4b8e-9448-48b6-80f9-dd3d9e4f0a0c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.202576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4b8e-9448-48b6-80f9-dd3d9e4f0a0c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.202668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6b4b8e-9448-48b6-80f9-dd3d9e4f0a0c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.204096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 192/381] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:39.209544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68d35-d06a-47e5-a7e0-c791e0bd15b4 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.209897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68d35-d06a-47e5-a7e0-c791e0bd15b4 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.210185 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e68d35-d06a-47e5-a7e0-c791e0bd15b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.240532 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-d4e68d35-d06a-47e5-a7e0-c791e0bd15b4 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:39.241733 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-d4e68d35-d06a-47e5-a7e0-c791e0bd15b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:39.346570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 190/382] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:39.371460 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd123bb-2579-4920-b6b1-e6ff2c06c612 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.371814 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd123bb-2579-4920-b6b1-e6ff2c06c612 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.372057 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd123bb-2579-4920-b6b1-e6ff2c06c612 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.373727 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 193/383] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:39.379817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.380115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.380398 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.382797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd123bb-2579-4920-b6b1-e6ff2c06c612 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:39.400130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:39.402768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:39.432468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:39.530107 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd123bb-2579-4920-b6b1-e6ff2c06c612 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:39.535405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 191/384] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:39.551240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:39.563197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:39.573568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:39.574914 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.575476 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.576090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.590521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:39.601121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:39.602087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:39.602968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:39.606193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 194/385] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:39.613756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:39.739096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f238e915-8425-4d4b-b9ed-5ef6fd9380ed None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:39.780432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:39.782034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.782532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.783025 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.784754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:39.785421 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:39.787150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:39.797585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 195/386] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:39.804188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:39.838182 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c082bd-78b2-4688-946b-25e95e482448 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:39.854902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:39.929065 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:39.929896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.930184 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.930517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.941436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9397ba7-1498-4c4a-80f9-9f89a248f208 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:39.974453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:39.977164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:39.978104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:39.978499 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:39.978829 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:39.980106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:39.981548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:39.982754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:39.983682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:39.984505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:39.985092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 196/387] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:39 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:39.985167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 192/388] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 422 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:39.993149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:39.997121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:40.033099 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:40.240511 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe6026c-c448-41df-b120-a33568c9f72f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:40.253152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ad94e3-c0b8-4d42-8899-2960a70f40cd None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:40.271432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:40.292093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:40.292971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.293251 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.293528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.294844 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:40.297632 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:40.299534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 193/389] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:39 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:40.309583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:40.322932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:40.323617 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.323932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.324212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.324972 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:40.325280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:40.326735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:40.354099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 197/390] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:40.360889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:40.460160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:40.496340 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d91306a-6cb9-4eb8-803e-e39754563f15 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:40.545828 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:40.546649 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.547005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.548078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed/groups/4235934dc57147bb90c717b2406261f7/roles/ab8f66c9c17141c78f03d685bacac0dd` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.552825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] RBAC: Authorizing `identity:create_grant(project_id=9304cc0bba194ff5bca330be4184efed, group_id=4235934dc57147bb90c717b2406261f7, role_id=ab8f66c9c17141c78f03d685bacac0dd)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:40.554332 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:40.581594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 194/391] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 17 07:13:40 2022] PUT /identity/v3/projects/9304cc0bba194ff5bca330be4184efed/groups/4235934dc57147bb90c717b2406261f7/roles/ab8f66c9c17141c78f03d685bacac0dd => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:40.590399 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84f4b5d-dddc-4462-b67a-3a73c642ee67 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:40.643226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45bcd79-d930-47da-8b0a-65eec9aeda69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:40.644151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bcd79-d930-47da-8b0a-65eec9aeda69 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.644436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bcd79-d930-47da-8b0a-65eec9aeda69 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.644716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45bcd79-d930-47da-8b0a-65eec9aeda69 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.646023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bcd79-d930-47da-8b0a-65eec9aeda69 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:40.647578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45bcd79-d930-47da-8b0a-65eec9aeda69 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:40.649743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 198/392] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:40 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:40.656938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:40.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011a7fd-c5ae-477d-bbb1-323ce25f18b9 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.768932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011a7fd-c5ae-477d-bbb1-323ce25f18b9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.769437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d011a7fd-c5ae-477d-bbb1-323ce25f18b9 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.771197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 199/393] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:40.781543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.781963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.782365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.808357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52f871a-dfe6-4350-85ff-9c15dedf0aaa None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:40.811084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:40.812299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:40.861264 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:40.876372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:40.877962 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:40.878247 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:40.878528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:40.881460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:40.882941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:40.885401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 195/394] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:40 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:40.892019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:40.917977 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:40.947494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 200/395] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:41.006708 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.077902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62ebef-f973-4c70-bb26-9fb496fb1abd None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:41.148992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec5f915-0130-49f7-8683-1bfe6e31dd06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:41.149888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5f915-0130-49f7-8683-1bfe6e31dd06 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.150171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5f915-0130-49f7-8683-1bfe6e31dd06 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.150448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec5f915-0130-49f7-8683-1bfe6e31dd06 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/groups/4235934dc57147bb90c717b2406261f7/roles/ab8f66c9c17141c78f03d685bacac0dd` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.160695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5f915-0130-49f7-8683-1bfe6e31dd06 None admin] RBAC: Authorizing `identity:create_grant(project_id=43c77278a4704b0a83a8ddd7e9eeafc0, group_id=4235934dc57147bb90c717b2406261f7, role_id=ab8f66c9c17141c78f03d685bacac0dd)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:41.162185 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec5f915-0130-49f7-8683-1bfe6e31dd06 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:41.187893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 196/396] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 17 07:13:40 2022] PUT /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/groups/4235934dc57147bb90c717b2406261f7/roles/ab8f66c9c17141c78f03d685bacac0dd => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:41.190048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3c67e-fcd2-4191-8d54-1db0b67f2624 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.190379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3c67e-fcd2-4191-8d54-1db0b67f2624 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.190726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a3c67e-fcd2-4191-8d54-1db0b67f2624 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.192452 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 197/397] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:41.206616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.206896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.207178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.209826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0686c58-2358-488b-a028-19e12d351c40 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:41.256055 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:41.257692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:41.269869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:41.270771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.271058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.271383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.286175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:41.296042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:41.297226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:41.298227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 201/398] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:41.306123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.342915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:41.434005 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a72792-454a-47a4-9466-bc45a6d08d99 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:41.475980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:41.480755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:41.481588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.481994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.482406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.483278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:41.483625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:41.485690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:41.488538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 198/399] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:41.499079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 202/400] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:41.501627 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.516124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.618360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beaf84df-8d04-4b37-b277-cd5229cb131a None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:41.625056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:41.634855 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a15bf-08a1-4a36-9ece-e2c5dbe03938 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:41.670286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e8c32-702b-4123-8b0c-ed7ee699cb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:41.671720 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e8c32-702b-4123-8b0c-ed7ee699cb33 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.672241 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e8c32-702b-4123-8b0c-ed7ee699cb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.672721 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e8c32-702b-4123-8b0c-ed7ee699cb33 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.673036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa134f4-5f1b-4b3c-9a48-623ed270a57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:41.673887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa134f4-5f1b-4b3c-9a48-623ed270a57e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.674181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa134f4-5f1b-4b3c-9a48-623ed270a57e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.674463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa134f4-5f1b-4b3c-9a48-623ed270a57e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.675043 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e8c32-702b-4123-8b0c-ed7ee699cb33 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:41.676870 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2e8c32-702b-4123-8b0c-ed7ee699cb33 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:41.679085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 199/401] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:41.680619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7806fb-9811-4e87-bdc8-98c04d68ee29 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.681135 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7806fb-9811-4e87-bdc8-98c04d68ee29 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.681808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7806fb-9811-4e87-bdc8-98c04d68ee29 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.683791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 200/402] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:41.686289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7806fb-9811-4e87-bdc8-98c04d68ee29 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.691797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa134f4-5f1b-4b3c-9a48-623ed270a57e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-4aa134f4-5f1b-4b3c-9a48-623ed270a57e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:41.700225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:41.701451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:41.702332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 203/403] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:41.707906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.707906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.707906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.727232 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:41.728412 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:41.781238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:41.826579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 204/404] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:41.828066 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.839709 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7806fb-9811-4e87-bdc8-98c04d68ee29 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:41.902522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:41.903905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:41.904627 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:41.905085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:41.906994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:41.909500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:41.912371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 201/405] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:41.920983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:41.936397 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:41.962564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14991dd-0f47-4321-ba17-a04ba152b9fc None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.005220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.006218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.006670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.007708 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.008669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:42.009131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:42.010988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:42.028334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 205/406] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:42.030747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.092785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62220dd-80c0-48c4-a427-8b53ed430e27 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.146147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.147483 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.147858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.148317 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.153320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:42.173353 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8af02c-476f-4ae1-ab2c-a74a2ecc143a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.175952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:42.186696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:42.187698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:42.188548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:42.194038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 202/407] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:42.194038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.223756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.224768 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.225136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.225328 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/groups/4235934dc57147bb90c717b2406261f7/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.231958 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] RBAC: Authorizing `identity:create_grant(project_id=43c77278a4704b0a83a8ddd7e9eeafc0, group_id=4235934dc57147bb90c717b2406261f7, role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:42.234014 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:42.256873 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 206/408] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 17 07:13:42 2022] PUT /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0/groups/4235934dc57147bb90c717b2406261f7/roles/482894a175b245f6b17bc1592bbbc982 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:42.264953 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.268663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:42.365059 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f729ba30-f582-4041-ab94-eddbab50447f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.446771 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.448060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.448597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.449077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.451404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:42.453166 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:42.466139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 203/409] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:42 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:42.471627 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.495005 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23154a8a-7aa1-4ddb-a2da-23220a22ca5d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.551089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.552387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.553139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.554062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.555045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:42.555564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:42.558323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:42.559300 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:42.575550 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 207/410] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:42.585703 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.621806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253bb584-fc5c-4311-b904-d82069f0e068 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.666650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.668995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.669351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.669700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.671202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:42.673596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:42.676095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 204/411] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:42 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:42.682901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.728423 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:42.810958 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98f089d-14cc-489b-a31b-93006c353cfa None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.911266 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:42.912407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:42.912745 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:42.913066 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] PATH_INFO: `/v3/groups/b85a0f703c2546a5b23b30c5143b5277` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:42.914591 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] RBAC: Authorizing `identity:get_group(group_id=b85a0f703c2546a5b23b30c5143b5277)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:42.916562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:42.918913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 208/412] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:42 2022] GET /identity/v3/groups/b85a0f703c2546a5b23b30c5143b5277 => generated 229 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:42.924668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:42.932273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0120fc-63ba-4647-8943-481e4ed35703 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:42.996272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:43.010459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:43.011375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:43.011665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:43.011971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed/groups/4235934dc57147bb90c717b2406261f7/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:43.017882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] RBAC: Authorizing `identity:create_grant(project_id=9304cc0bba194ff5bca330be4184efed, group_id=4235934dc57147bb90c717b2406261f7, role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:43.019376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:43.042361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 205/413] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 17 07:13:42 2022] PUT /identity/v3/projects/9304cc0bba194ff5bca330be4184efed/groups/4235934dc57147bb90c717b2406261f7/roles/482894a175b245f6b17bc1592bbbc982 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:43.066930 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24389f5-1412-4d95-836b-cbcf3cbb5f84 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:43.109710 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:43.124082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe1986-f8b3-4a06-8c1e-7a1d08eb7e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:43.125139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1986-f8b3-4a06-8c1e-7a1d08eb7e2b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:43.125477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1986-f8b3-4a06-8c1e-7a1d08eb7e2b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:43.125767 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe1986-f8b3-4a06-8c1e-7a1d08eb7e2b None admin] PATH_INFO: `/v3/projects/e81febd8e3c144628e032f30cc71dcf0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:43.128724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1986-f8b3-4a06-8c1e-7a1d08eb7e2b None admin] RBAC: Authorizing `identity:get_project(project_id=e81febd8e3c144628e032f30cc71dcf0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:43.130547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe1986-f8b3-4a06-8c1e-7a1d08eb7e2b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:43.133037 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 209/414] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:42 2022] GET /identity/v3/projects/e81febd8e3c144628e032f30cc71dcf0 => generated 344 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:43.140236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:43.304004 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a747-6dcc-432d-8e35-f26694bf17f5 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:43.304725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a747-6dcc-432d-8e35-f26694bf17f5 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:43.305244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f914a747-6dcc-432d-8e35-f26694bf17f5 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:43.308293 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 210/415] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:43.313774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:43.315106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:43.315632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:43.321411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50142f1c-ddb8-4b88-9594-8af6491dfa78 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:43.359553 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:43.361073 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:43.365643 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:43.366567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:43.366856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:43.367138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] PATH_INFO: `/v3/projects/e81febd8e3c144628e032f30cc71dcf0/groups/b85a0f703c2546a5b23b30c5143b5277/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:43.369326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] RBAC: Authorizing `identity:create_grant(project_id=e81febd8e3c144628e032f30cc71dcf0, group_id=b85a0f703c2546a5b23b30c5143b5277, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:43.370844 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:43.388443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 206/416] 10.222.0.58 () {58 vars in 1442 bytes} [Fri Jun 17 07:13:43 2022] PUT /identity/v3/projects/e81febd8e3c144628e032f30cc71dcf0/groups/b85a0f703c2546a5b23b30c5143b5277/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:13:43.473779 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 211/417] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:43.514886 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:43.601665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:43.665212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c1116a-2529-4b03-8d27-f45848875b74 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:43.724365 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:43.725406 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:43.725765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:43.726147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:43.748067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:43.767147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:43.768448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:43.769607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:43.775451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 207/418] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:43.777735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.027018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fd6125-27d0-4e8f-94b3-44efbb8af988 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:44.080003 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:44.093436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:44.094423 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.094846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.095263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.096993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:44.097459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:44.099649 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07693dc-35f7-4454-ae48-598054ba0e23 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:44.123382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 212/419] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:44.129666 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.222884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a6f4-3716-4531-a176-1e0ff9c9bed4 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.223195 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a6f4-3716-4531-a176-1e0ff9c9bed4 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.223450 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520a6f4-3716-4531-a176-1e0ff9c9bed4 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.225041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 213/420] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:44.230671 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.231222 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.231708 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.250557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:44.252586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:44.265541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a52b314-cf1a-45b7-8bd2-eff4b64bfd4f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:44.292659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:44.336887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:44.337557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.337842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.338121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.357528 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 214/421] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:44.384080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.434896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:44.436404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:44.557799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 208/422] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:44.565398 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.588286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:44.658860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054e6589-b04a-42a8-bc00-a94fe11b4781 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:44.703954 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6c1911-5edb-4a0a-9133-f13fb8298e92 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:44.715245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:44.737168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:44.737978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.738258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.738529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.759461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:44.767258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:44.768270 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jun 17 07:13:44.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:44.772404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 215/423] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 389 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:44.776788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:44.778028 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.778369 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.778730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.780573 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.781591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:44.783063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:44.793416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 209/424] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:44 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:44.794333 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.901712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112872c2-6fb4-4a36-afdb-a6be8899efb2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:44.938558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:44.939240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:44.940111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:44.940388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:44.941191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:44.941504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:44.942890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:44.948173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:44.952380 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 216/425] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:13:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:44.958710 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:44.999140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8ab25c-3884-4e67-baaa-7912e2123885 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.052189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:45.066763 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.067694 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.068003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.068280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.069758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:45.071210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:45.073211 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 210/426] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:44 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:45.084162 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:45.139426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35e9137-052a-4f46-9759-262dc6b2e3d5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.174750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.175684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.176228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.176676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.221529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e25266-4029-402b-86de-1b5e7585dc50 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.249623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:45.251340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:45.265481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.266625 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.267177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.268048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.269249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=9304cc0bba194ff5bca330be4184efed) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:45.269846 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:45.272254 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332221a0-3289-4823-b63f-1e6b80f1471c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:45.287986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 211/427] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 611 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:45.287986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f069dcf-9e14-4d24-9b6e-36a6e39b7178 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.287986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f069dcf-9e14-4d24-9b6e-36a6e39b7178 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.287986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f069dcf-9e14-4d24-9b6e-36a6e39b7178 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.293622 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 212/428] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:45.296161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.296282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.296838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.317434 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:45.323121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:45.325554 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:45.331416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:45.422634 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 217/429] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:45.431063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 213/430] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:45.434310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:45.459160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:45.551482 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37fec01-f620-478d-804b-bf5b453b968f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.596699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c07af4-fa9d-48a4-bb58-27cea9972005 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.610531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.612171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.612458 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.612773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.614094 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:45.615631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:45.618013 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 218/431] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:45.625255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:45.645259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:45.655212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.661320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.661320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.661998 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.698798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:45.700389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:45.717839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:45.719651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:45.721604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 214/432] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:45.730819 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:45.791559 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1845930e-71cd-406a-9f0d-a97ac8c55340 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.844847 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.848007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.849023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.850287 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.853050 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:45.856176 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:45.867791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 219/433] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:45.872143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:45.878264 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895cc0d7-7364-4877-b481-51921ddddbb3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:45.926218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:45.926981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:45.927300 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:45.927618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:45.928570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:45.928928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:45.930552 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:45.947597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 215/434] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:45.948876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.019081 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.038999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.045193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99742c01-6300-4b99-a851-7d7623fa40a5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.083125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.083806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.084093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.084372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.085212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=ab8f66c9c17141c78f03d685bacac0dd, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:46.085554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:46.086962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644eb7a-29eb-4261-b20e-7aa19186e8f1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:46.093157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 220/435] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=ab8f66c9c17141c78f03d685bacac0dd => generated 611 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:46.094411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dbd54-1041-468e-9712-886c31a1c0ed None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.094699 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dbd54-1041-468e-9712-886c31a1c0ed None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.094976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047dbd54-1041-468e-9712-886c31a1c0ed None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.097199 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 221/436] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:46.102876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.103156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.103438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.113429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b0ceb-470e-4499-bb91-06f76ab9e8d0 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.121971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:46.123234 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:46.171750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6f7c5f-bc15-429a-a03d-06fde2df0573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.172564 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7c5f-bc15-429a-a03d-06fde2df0573 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.172928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7c5f-bc15-429a-a03d-06fde2df0573 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.173276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6f7c5f-bc15-429a-a03d-06fde2df0573 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.226731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 222/437] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:46.252957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.276614 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f7c5f-bc15-429a-a03d-06fde2df0573 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:46.278130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6f7c5f-bc15-429a-a03d-06fde2df0573 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:46.347465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.362668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.384102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5717226d-b658-43c4-b3b0-3f0217027a60 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.423345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 216/438] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:46.425608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17ab2-8970-4eac-ac54-8f0313212c16 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.426120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17ab2-8970-4eac-ac54-8f0313212c16 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.426519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c17ab2-8970-4eac-ac54-8f0313212c16 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.439994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 217/439] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:46 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:46.440171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c53a1-81b8-45cc-9543-72f73a2e24c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.440291 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17ab2-8970-4eac-ac54-8f0313212c16 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.440367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c53a1-81b8-45cc-9543-72f73a2e24c5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.440367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c53a1-81b8-45cc-9543-72f73a2e24c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.440367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c53a1-81b8-45cc-9543-72f73a2e24c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.454434 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2c53a1-81b8-45cc-9543-72f73a2e24c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-fa2c53a1-81b8-45cc-9543-72f73a2e24c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:46.464392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:46.465372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:46.466177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:46.466789 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 223/440] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:46.468007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.468134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.468425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.486209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:46.487322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:46.566546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c17ab2-8970-4eac-ac54-8f0313212c16 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.574030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 224/441] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:46.574980 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.617296 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.618173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.618454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.618728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] PATH_INFO: `/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.619939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] RBAC: Authorizing `identity:get_project(project_id=43c77278a4704b0a83a8ddd7e9eeafc0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:46.621407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:46.623109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 218/442] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/projects/43c77278a4704b0a83a8ddd7e9eeafc0 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:46.623891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.643068 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.655592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.684040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043a69c-c8f4-4f62-82d4-5ea925777b68 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.720915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.721666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.721976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.722269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.723106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:46.723451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:46.725023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:46.729144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b45dfa-0610-4d10-a67f-ba80a821fe57 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.734319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 225/443] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:46.735285 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.765447 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.766164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.766441 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.766719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.776893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:46.784839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:46.785872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:46.786742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 219/444] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:46.787388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.850641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e9a6c2-b3f6-466c-93d2-a784be65e318 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.879106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.886936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:46.888086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.889429 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.889869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.889869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:46.891178 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:46.892665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:46.894633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 226/445] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:46.895077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:46.904069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfe0bce-2050-4a0c-8656-e8c77a49f1e3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:46.940922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:46.941568 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:46.941918 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:46.942197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.003660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e330a-884e-4162-83c0-d8c447363e89 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.013260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.014741 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.037577 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.038173 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.038456 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.038729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.039471 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:47.039799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.041170 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.052038 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 227/446] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:47.052887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.116150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:47.117507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:47.128238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 220/447] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:47.129153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.171853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4737497-0fa4-4b6f-9271-54634d6cd162 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.208159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.208820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.209106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.209383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.210224 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:47.210541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.211995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.218070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 228/448] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=43c77278a4704b0a83a8ddd7e9eeafc0&role.id=482894a175b245f6b17bc1592bbbc982 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:47.218875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.241011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccba322a-c73e-4e80-bcbf-634a61f92d10 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.283876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.284534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.284813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.285092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.359867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23763dfd-5ad7-46dd-8d20-fb537cb03b33 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.362365 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:47.379651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.380676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.384347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:47.406668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.407577 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.408549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.409061 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] PATH_INFO: `/v3/projects/9304cc0bba194ff5bca330be4184efed` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.410547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] RBAC: Authorizing `identity:get_project(project_id=9304cc0bba194ff5bca330be4184efed)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.411875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.413819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 229/449] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/projects/9304cc0bba194ff5bca330be4184efed => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:47.421340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.527812 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 221/450] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:47.534048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.552343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac20e91-e521-4cb3-b766-6679646170a9 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.596006 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.597148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.597385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.598581 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] PATH_INFO: `/v3/groups/4235934dc57147bb90c717b2406261f7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.599546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] RBAC: Authorizing `identity:get_group(group_id=4235934dc57147bb90c717b2406261f7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.601334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.603914 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 230/451] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/groups/4235934dc57147bb90c717b2406261f7 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:47.609549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.639643 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:47.655139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef460b7e-0794-4edf-8f83-9427129ff959 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.680879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:47.702747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.704212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.704689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.705512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] PATH_INFO: `/v3/projects/e81febd8e3c144628e032f30cc71dcf0` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.706783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] RBAC: Authorizing `identity:get_project(project_id=e81febd8e3c144628e032f30cc71dcf0)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.708710 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.711814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 222/452] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/projects/e81febd8e3c144628e032f30cc71dcf0 => generated 344 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:47.718644 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:47.743731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d8ef2-a6dc-49d6-8a37-057237138cdc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.793534 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.793806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.794153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.794453 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.795397 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] RBAC: Adding query filter params (group.id=4235934dc57147bb90c717b2406261f7, role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=9304cc0bba194ff5bca330be4184efed) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:47.795793 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.797390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.804599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 231/453] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/role_assignments?group.id=4235934dc57147bb90c717b2406261f7&scope.project.id=9304cc0bba194ff5bca330be4184efed&role.id=482894a175b245f6b17bc1592bbbc982 => generated 611 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:47.832244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d91ef-7ec9-4847-939a-aa8bc9bc76b9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:47.873239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7105189-658f-40bc-89b7-e67a31e9e6e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:47.875310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105189-658f-40bc-89b7-e67a31e9e6e9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:47.875310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105189-658f-40bc-89b7-e67a31e9e6e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:47.875310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7105189-658f-40bc-89b7-e67a31e9e6e9 None admin] PATH_INFO: `/v3/groups/b85a0f703c2546a5b23b30c5143b5277` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:47.877084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7105189-658f-40bc-89b7-e67a31e9e6e9 None admin] RBAC: Authorizing `identity:get_group(group_id=b85a0f703c2546a5b23b30c5143b5277)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:47.878043 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7105189-658f-40bc-89b7-e67a31e9e6e9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:47.880114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 223/454] 10.222.0.58 () {56 vars in 1180 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/groups/b85a0f703c2546a5b23b30c5143b5277 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:47.886663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:48.009388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b24044-57d7-4fce-b73d-925869b02510 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:48.036080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:48.055612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:48.056334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:48.056622 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:48.056897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:48.057741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] RBAC: Adding query filter params (group.id=b85a0f703c2546a5b23b30c5143b5277, role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=e81febd8e3c144628e032f30cc71dcf0) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:48.058054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:48.059680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2f14cf-b598-4036-87e2-71325cf63eb4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:48.068600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 232/455] 10.222.0.58 () {56 vars in 1376 bytes} [Fri Jun 17 07:13:47 2022] GET /identity/v3/role_assignments?group.id=b85a0f703c2546a5b23b30c5143b5277&scope.project.id=e81febd8e3c144628e032f30cc71dcf0&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:50.812508 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7acbef-4613-4317-8d39-f29ced17fd56 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:50.813565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7acbef-4613-4317-8d39-f29ced17fd56 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:50.814658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7acbef-4613-4317-8d39-f29ced17fd56 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:50.816553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 224/456] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:50.822324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67b474-c9b5-4242-902b-f2e45a4814e2 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:50.823213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67b474-c9b5-4242-902b-f2e45a4814e2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:50.823696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df67b474-c9b5-4242-902b-f2e45a4814e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:50.848772 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-df67b474-c9b5-4242-902b-f2e45a4814e2 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:50.850322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-df67b474-c9b5-4242-902b-f2e45a4814e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:50.944947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 233/457] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:50.969847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7acbef-4613-4317-8d39-f29ced17fd56 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:51.003387 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:51.116048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7acbef-4613-4317-8d39-f29ced17fd56 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:51.183349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:51.184560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.185057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.185538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.202331 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:51.204142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:51.216379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ccea2-71fe-4343-be95-c15c5d3c646d None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.217056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ccea2-71fe-4343-be95-c15c5d3c646d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.217580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4ccea2-71fe-4343-be95-c15c5d3c646d None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.219165 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 234/458] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:51.225448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe1b3-59b6-4863-8446-5e15f7f3b5c1 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.226021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe1b3-59b6-4863-8446-5e15f7f3b5c1 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.226601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13abe1b3-59b6-4863-8446-5e15f7f3b5c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:51.237295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:51.238167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:51.239422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:51.239422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:51.239422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:51.239422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:51.239422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 225/459] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:51.245725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:51.271939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-13abe1b3-59b6-4863-8446-5e15f7f3b5c1 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:51.273179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-13abe1b3-59b6-4863-8446-5e15f7f3b5c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:51.345122 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:51.367134 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6f816e-7d36-485f-bd33-3df8f0624ade None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:51.404391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 235/460] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:51.405029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:51.405936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c929c-4432-4106-8b71-a1075318c90b None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.406166 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.406338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c929c-4432-4106-8b71-a1075318c90b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.406642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c929c-4432-4106-8b71-a1075318c90b None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.407033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.407508 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.409374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:51.409900 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:51.411517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:51.416701 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 236/461] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:51 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:51.431024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.431024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.431024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.431543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 226/462] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:51.432878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:51.462828 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:51.464237 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:51.519156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:51.553244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8195f55-1c63-498b-984e-a65f8812c243 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:51.563877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 237/463] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:51.565866 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:51.608434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:51.609462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.609953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.610455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.611421 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:51.613097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:51.622885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:51.643252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 227/464] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:51 2022] POST /identity/v3/users => generated 246 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:13:51.644417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:51.717348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca61b7-5d21-4eab-8b4f-4c8787fa465d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:51.757591 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:51.758520 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.758879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.759233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.771113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:51.772756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:51.789275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f8170e-c2a9-45e0-89b2-301cb15aea5a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d1027cae-084a-4898-82a8-230748fb4f06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:51.793181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:51.794078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:51.794907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:51.794907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:51.794907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:51.794907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:51.800365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 238/465] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:51.801973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402224b-6080-4ad2-b70e-c10744ebf7b2 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.802345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402224b-6080-4ad2-b70e-c10744ebf7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.802717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0402224b-6080-4ad2-b70e-c10744ebf7b2 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.808702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 239/466] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:51.808702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402224b-6080-4ad2-b70e-c10744ebf7b2 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:51.836861 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:51.856529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:51.857982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.858451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.859367 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.875330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:51.877650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-a87ccea6-e4c7-496b-a28d-c556c7e7d752 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:51.898565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:51.900626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:51.901592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:51.901592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:51.901592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:51.901592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:51.901592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 228/467] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:51.903794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.903794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.903794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.931209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:51.933052 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:51.938255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0402224b-6080-4ad2-b70e-c10744ebf7b2 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:51.976587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:51.977261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:51.977552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:51.977946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:51.978966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:51.979285 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:51.980902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:51.987646 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:51.994448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 240/468] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:51.995686 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.014466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 229/469] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:52.015425 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.131267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:52.141468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d154d7c-5e0b-44aa-b1e1-d56be84a4a58 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.147890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502316b-3e07-461d-b875-2198642d5974 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.199826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70789c92-a4a9-4139-b0ad-04815dc70459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.200899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789c92-a4a9-4139-b0ad-04815dc70459 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.201372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789c92-a4a9-4139-b0ad-04815dc70459 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.201838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70789c92-a4a9-4139-b0ad-04815dc70459 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.203066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789c92-a4a9-4139-b0ad-04815dc70459 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.205276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.206114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70789c92-a4a9-4139-b0ad-04815dc70459 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.206291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.206751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.207365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.208564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:52.209065 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.211157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.230105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 241/470] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:52.231304 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.238305 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 230/471] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:52 2022] POST /identity/v3/users => generated 248 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:52.239360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f12f6-d046-4b13-b5e4-c238d69d54d8 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.239659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f12f6-d046-4b13-b5e4-c238d69d54d8 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.239970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f12f6-d046-4b13-b5e4-c238d69d54d8 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.241424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 231/472] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:52.241966 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f12f6-d046-4b13-b5e4-c238d69d54d8 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.284943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:52.386819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb92eeb-3436-4149-b5e3-66cb0d182be9 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.397565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f12f6-d046-4b13-b5e4-c238d69d54d8 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.445892 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.446719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.446981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.447257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.452386 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b1ebc-7828-4330-b87c-61532ac97270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.453060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1ebc-7828-4330-b87c-61532ac97270 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.453343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1ebc-7828-4330-b87c-61532ac97270 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.453616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b1ebc-7828-4330-b87c-61532ac97270 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.454323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1ebc-7828-4330-b87c-61532ac97270 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.456270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79b1ebc-7828-4330-b87c-61532ac97270 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.459552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.461065 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.472334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:52.485843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 232/473] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:52 2022] POST /identity/v3/users => generated 248 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:52.487693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.489388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.489388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:52.489609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:52.490401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:52.492282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:52.492282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:52.492282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:52.492282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:52.492282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 242/474] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:52.498907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.512464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:52.513735 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:52.621731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 233/475] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:52.647506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.649601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f9015d-0b09-489c-97ba-0917d973dc44 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.686164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:52.695215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.695943 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.696236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.696521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.697451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:52.697561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.698961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.736950 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 243/476] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:52.743529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.815397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45795b43-1712-44e9-9ac9-1df2dfb09851 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.830634 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:52.856128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.857023 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.857621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.857704 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.858603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.860217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.867808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.sql.core [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 07:13:52.867808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 07:13:52.867808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [parameters: {'id': '6765b656596f4b8995256e76dc6aa411', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 07:13:52.867808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 07:13:52.881447 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acc615b-30b6-46a9-94df-1dd44a7984c5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result.read() Jun 17 07:13:52.891210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return ref.to_dict() Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:13:52.892734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application yield resource Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise self.value Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application session.commit() Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 07:13:52.893676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.session.flush() Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application compat.raise_( Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 07:13:52.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:13:52.895388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result.read() Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:13:52.896277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [parameters: {'id': '6765b656596f4b8995256e76dc6aa411', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:52.897061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jun 17 07:13:52.897902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:52.901649 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 234/477] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 17 07:13:52 2022] POST /identity/v3/roles => generated 144 bytes in 247 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:52.901649 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:52.931942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:52.932993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:52.933497 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:52.933974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:52.935183 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:52.936989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:52.962703 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 244/478] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:52 2022] POST /identity/v3/users => generated 249 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:13:53.019490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:53.053108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0836cdd4-7df5-41d0-963e-8017f8d1646f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:53.104811 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3c3be-d0e0-4d04-8130-8f41e5b7207f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:53.105688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c3be-d0e0-4d04-8130-8f41e5b7207f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:53.106027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c3be-d0e0-4d04-8130-8f41e5b7207f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:53.106311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3c3be-d0e0-4d04-8130-8f41e5b7207f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:53.121730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3c3be-d0e0-4d04-8130-8f41e5b7207f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-21e3c3be-d0e0-4d04-8130-8f41e5b7207f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:53.131847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:53.132804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:53.133832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 235/479] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:53.143193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:53.272576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f675031-b8cf-4cd1-9a0f-5d26e2ba5412 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:53.289755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:53.316086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:53.316940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:53.317233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:53.317555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:53.318404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:53.318756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:53.320509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348cf5dd-d88b-46d8-9659-1ab3878fae55 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:53.330618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 245/480] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:54.292093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a551f-57ce-43ee-9f30-60587f787b39 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:54.292597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a551f-57ce-43ee-9f30-60587f787b39 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:54.292861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27a551f-57ce-43ee-9f30-60587f787b39 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:54.294499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 236/481] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:54.300216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:54.300632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:54.300857 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:54.328885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:54.330917 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:54.429653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 246/482] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:54.466608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a551f-57ce-43ee-9f30-60587f787b39 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:54.637011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27a551f-57ce-43ee-9f30-60587f787b39 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:54.687639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:54.688411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:54.689215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:54.689510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:54.707824 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:54.715788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:54.716674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:54.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:54.718816 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 237/483] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:13:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:54.723629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:54.878327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058bf2ff-2262-444a-9e20-a04739c0bbac None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:54.891105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:54.933575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:54.934261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:54.934548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:54.934827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:54.935580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:54.935915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:54.937283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3fc647-225c-4893-b643-2d74b3e7f6f0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:54.952637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 247/484] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:13:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:54.957967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:54.963101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:55.087910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b31b-fa89-4ba0-b5d9-ce6c6de9d12b None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.088327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b31b-fa89-4ba0-b5d9-ce6c6de9d12b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.088539 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50b31b-fa89-4ba0-b5d9-ce6c6de9d12b None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.090389 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 248/485] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:13:55.096208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.096499 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.096816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.120837 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:55.122037 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:55.153187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be440f9-d4ef-46c3-aedb-cbe39a9dfab5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:55.222922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:55.223642 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.223947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.224222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.231913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 249/486] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:13:55.240654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:55.242130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:55.261453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:55.262360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:55.263191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:55.263191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:55.263191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:55.263191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:55.263924 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 238/487] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:55.270258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:55.273937 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:55.359029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:55.429985 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:55.436379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcdc632-d0b4-4b4a-918d-de815b17e579 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:55.474006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd82080-a826-4283-890a-2323c5685412 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:55.493786 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:55.494547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.494926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.495246 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.496117 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:55.496434 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:55.500046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:55.530598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 250/488] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:55.545712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:55.559733 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:55.560847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.561307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.561583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.590262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:55.599267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:55.600635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:55.602256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 239/489] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:13:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:55.607171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:55.734167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a2a64-e4ed-43cc-990f-b830bc7516dc None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:55.752654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:55.759630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb3a139-0878-4a70-a900-427864448d6d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:55.780787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:55.781555 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.781872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.782683 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.783089 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:55.783436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:55.785147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629787d4-ed04-421a-98c7-2890706527e4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:55.797150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 240/490] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:13:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:13:55.800473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:55.801257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d216-737b-4f0e-9225-c742bf35368f None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.801746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d216-737b-4f0e-9225-c742bf35368f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.802033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca6d216-737b-4f0e-9225-c742bf35368f None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.803572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 241/491] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:55.804484 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.804834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.805115 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.806407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d216-737b-4f0e-9225-c742bf35368f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:55.816457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:55.817951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-beb42197-06ea-433f-8181-d63cd7c70c1f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:13:55.834213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:55.835277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:55.836339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 251/492] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:13:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:13:55.837000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15195b-2241-436d-b28e-fa698422829d None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.837649 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15195b-2241-436d-b28e-fa698422829d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.837815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad15195b-2241-436d-b28e-fa698422829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:55.862653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-ad15195b-2241-436d-b28e-fa698422829d None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:55.864409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-ad15195b-2241-436d-b28e-fa698422829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:55.883546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:55.934806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca6d216-737b-4f0e-9225-c742bf35368f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:55.954881 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 252/493] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:55.956167 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15195b-2241-436d-b28e-fa698422829d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:55.997205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:55.997941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:55.998226 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:55.998504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.011437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.012953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:56.031940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:56.032905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:56.033758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:56.033758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:56.033758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:56.033758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:56.037912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 242/494] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:56.038847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.069021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad15195b-2241-436d-b28e-fa698422829d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.075520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.108752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.109876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.110385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.111432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.112624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:56.113171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.114885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.162555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 253/495] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:13:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:56.168034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.176545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df680eeb-9df5-4881-84e9-4e3d4f9f341a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.180567 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.215393 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.216222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.216503 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.216779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.228891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:56.237221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:56.238183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:56.238984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 243/496] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:56.239638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.294879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dc1fa8-ed8b-4db6-b5cb-4366a08e9ef7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.333238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.333923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.334204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.334478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.335204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:56.335511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.337251 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ff16e4-aba4-490b-8912-b4262853135d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.347499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.351051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 254/497] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:56.352387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e8e12-a234-4d33-a771-db834086060c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.352680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e8e12-a234-4d33-a771-db834086060c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.352957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8e8e12-a234-4d33-a771-db834086060c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.354596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 255/498] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:56.358959 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e8e12-a234-4d33-a771-db834086060c None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.370372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8857fa2b-f4d9-403a-85e8-7ce85b3c1269 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.417970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bba333c-e1c5-4d89-898f-1567549e04e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.418630 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba333c-e1c5-4d89-898f-1567549e04e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.419066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba333c-e1c5-4d89-898f-1567549e04e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.419361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bba333c-e1c5-4d89-898f-1567549e04e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.446007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.489633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8e8e12-a234-4d33-a771-db834086060c None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.496427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba333c-e1c5-4d89-898f-1567549e04e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.497931 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bba333c-e1c5-4d89-898f-1567549e04e8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.528121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.528801 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.529347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.529620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.530372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:56.530676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.532112 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.541581 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 256/499] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:56.542384 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.599120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.614725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 244/500] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:56.616420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f80b0-dd0d-4439-9459-9f744bdb5d9f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.616714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f80b0-dd0d-4439-9459-9f744bdb5d9f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.617187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97f80b0-dd0d-4439-9459-9f744bdb5d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.634569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c97f80b0-dd0d-4439-9459-9f744bdb5d9f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:56.635816 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c97f80b0-dd0d-4439-9459-9f744bdb5d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:56.662943 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad6b5c-0fcc-4cc0-a3a1-deb2e4b0cdfa None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.690317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.705027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.705901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.706125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.706408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.709327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 245/501] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:56.710657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1a67-21b7-4161-a7f2-0ea20c4878f1 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.710945 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1a67-21b7-4161-a7f2-0ea20c4878f1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.711222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141b1a67-21b7-4161-a7f2-0ea20c4878f1 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.712539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 246/502] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:13:56.713239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b1a67-21b7-4161-a7f2-0ea20c4878f1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.715570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.717093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:13:56.734288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:56.735244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 257/503] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/users/glance => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:56.737071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.839751 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141b1a67-21b7-4161-a7f2-0ea20c4878f1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.854856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2354655-cb9d-4aa1-8985-55049814fac2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:56.861841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:56.881040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.881839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.882126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.882401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.892552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:56.893587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.893915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.894019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.894252 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.895437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.906736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:56.908529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-33a0edea-135d-4347-9d61-e9b3a8c3bd61 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:56.914390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:56.915258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:56.916121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:56.916121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:56.916121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:56.916121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:56.916121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 247/504] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:56.920683 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:56.920683 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:56.920683 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:56.936573 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:13:56.937755 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:56.942257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:56.943248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:56.944243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:56.944243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:56.944243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:56.944243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:56.944243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 258/505] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:56.944915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:56.992863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.022110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 248/506] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:13:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:13:57.022110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.065626 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8792e8-5574-4307-b104-6153cf478d9b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.102706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.103524 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.103838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.104122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.114954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:13:57.122625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:57.124109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 259/507] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:13:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:57.125095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.138060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.141207 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3268f9aa-2118-4648-9be6-6f593212419c None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.185814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.186671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.187017 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.187368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.188429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:57.189431 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.191215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.236512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 249/508] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:57.237530 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.240409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d2faba-2b74-4067-9853-103146e0cd41 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.241998 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.282429 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.283195 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.283508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.283780 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.284587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:57.284906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.286569 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.299716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 260/509] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:57.300558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.357170 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b74d6fd-eb8f-43ac-a557-ab258e3932b5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.394008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.394826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.395118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.395397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.396154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:57.396456 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.398069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.408155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d2aeb9-c40a-44f3-9902-aa9f13290b67 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.410689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 250/510] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:57.416146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.447211 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.448670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.449489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.449774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.450051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.461854 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.463401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:57.482809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:57.483842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:57.484971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:57.484971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:57.484971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:57.484971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:57.484971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 261/511] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:57.484971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.512919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.550330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6299043-0fca-4752-81a7-bac7f726db08 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.597316 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.598004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.598289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.598567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.599311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:57.599620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.601046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.614598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc45dd63-f4d0-42df-af73-db7fcbb16bbb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.618358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 251/512] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:57.619181 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.655945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.656850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.657134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.657936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.705574 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.732853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d986a706-3a2c-4e20-9295-dbee35a0a2e8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.736856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.738751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.757236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.771981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.772788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.773067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.773351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.783382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.785126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:13:57.813359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:57.814339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:57.815215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 252/513] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:57.816171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.866104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 262/514] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:57.866972 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:57.933881 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8833-3447-4612-9890-eee11dce3bf0 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.969051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:57.969902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:57.970183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:57.970454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:57.977958 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e935cc-6849-45b3-ba9e-f96cc3de9651 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:57.978132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:57.979522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:57.982183 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.993871 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:13:57.995618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:57.997169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 253/515] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:57.998036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.019748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.020455 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.020746 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.021027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.021759 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:58.022071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.023446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.036191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 263/516] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:58.037046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.124668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41665a2-c91a-4f85-858f-7e699eeb7129 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.162958 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219015fe-c40b-4e99-af12-cb5a878435d2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.176665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.177636 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.177990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.178321 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.190010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.191396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.200831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.201937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.202289 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.202639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.203686 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:58.204095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.206323 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:58.209443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:58.210413 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:58.211301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:58.211301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:58.211301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:58.211301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:58.211301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 254/517] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:58.211842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.229194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 264/518] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:58.229889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.271660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:58.274837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:58.331445 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44197313-19f9-4de3-bbd4-3b6fa43abc1f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.355341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e24c9-3dab-4f6e-9422-2f47ee09f7f7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.381460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.382286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.382545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.382814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.395291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.396009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.396161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.396586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.396586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.397374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:58.397497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.397691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.399224 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:58.416116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:58.417031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:58.417857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:58.417857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:58.417857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:58.417857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:58.417857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 255/519] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:58.423261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 265/520] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:58.423417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.423509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.521060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:58.528405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7e41a1-e5c8-494c-b68f-51b200a156f2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.531208 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:58.532821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9051de-df58-4d21-8ca1-d1f2cca7c926 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.566926 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.567242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.567671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.567911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.568009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.568179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.568338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.568485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.569124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.569217 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:58.569462 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.570768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.570997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.583742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 266/521] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:58.584695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.594601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 256/522] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:13:58 2022] POST /identity/v3/users => generated 247 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:13:58.595957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.728707 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa51a93b-52f6-43a2-ac3f-50a40749230f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.730787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbddf1b1-6c42-4932-ab1e-51d7fd680b24 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.767848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.768505 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.768788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.769059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.784182 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.784865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.785196 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.785513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.786344 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:58.786692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.788281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.791600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:58.803652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 257/523] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:58.805057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:58.837775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:58.863357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.865186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.934520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad6ac7b-b97b-4669-bb8b-2daf242186cc None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:58.978188 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:58.978849 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:58.979133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:58.979409 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:58.980299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=4f968a9c3d3d4dbfb71216af67cd291e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:58.980618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:58.982103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:58.995799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 258/524] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/role_assignments?user.id=4f968a9c3d3d4dbfb71216af67cd291e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:58.995799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.008429 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 267/525] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:13:59.009938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.093547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:59.106487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:59.128168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba125587-ffb9-4e0f-8a4d-933257cf2da6 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.174173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.175100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.175482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.175887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.184053 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546642e8-5bc3-4217-9979-48f6a845bad9 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.188471 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.191330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:13:59.222081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:59.226006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:13:59.227619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:59.229467 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 259/526] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:13:58 2022] GET /identity/v3/users/neutron => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:59.230563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.240227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.241778 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.242387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.243078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.252909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.254625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:13:59.271092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:59.272161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:13:59.273090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:13:59.275648 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 268/527] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:59.276835 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.342118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41d4eef-672b-4a7e-8718-4fc10f6cfdac None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.379374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.380221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.380569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.380916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.393413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a7eb5-0855-4fee-9912-c3e5f0603f1b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.393933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.395839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.400159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:59.409917 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:13:59.419681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:13:59.421278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:13:59.422234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:13:59.422234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:13:59.422234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:13:59.422234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:13:59.422234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 260/528] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:13:59.422234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.449372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.450471 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.450934 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.451401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.452445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:59.452905 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.455368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.475494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 269/529] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:59.476601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.543076 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2cfa23-1c26-4e2b-9adc-b26fa675a116 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.580447 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.581271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.581652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.582024 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.582930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:59.583334 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.585078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.605703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 261/530] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:59.606113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79182d5-b30b-49df-a49c-19c7b4e84dbd None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.606809 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.651468 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.652523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.653025 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.653661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.655018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:59.655845 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.658898 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.673813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 270/531] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:59.674931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.683889 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:59.707042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:13:59.737996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd24a583-a6bd-46fc-808d-65155a3ecb33 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.776848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.777815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.778249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.778673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.791062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7523ea47-e3ec-41d5-ab49-af567443ce48 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:13:59.833241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:13:59.833971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:13:59.834273 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:13:59.834973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:13:59.835508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=0d6a4b1519b0433898a4b04bec38722b) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:13:59.835862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.837299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.848097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 271/532] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/role_assignments?user.id=0d6a4b1519b0433898a4b04bec38722b&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:13:59.848097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:13:59.880159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:13:59.882060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:13:59.953845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:00.030741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:00.046407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 262/533] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:00.049144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05244-bb72-4c3f-bbcd-ba53178c24b5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:00.051850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:00.128202 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:00.129080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:00.129375 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:00.129657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:00.143177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:00.144724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:00.169815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:00.170748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:00.171583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:00.172665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 272/534] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:13:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 328 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:00.181682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:00.250327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17b6b1-41c8-40dc-a264-24f52ba01d46 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:00.303921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab23ec92-7bfe-4111-86de-a0c7bb8f4af5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:00.323504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:00.324831 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:00.325318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:00.325792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:00.347919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:00.347919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:00.347919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:00.347919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:00.348297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:00.348738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:00.349937 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:00.351296 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:00.351871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:00.365551 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 273/535] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:00.373913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:00.392896 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:00.393938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:00.394769 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:00.394769 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:00.394769 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:00.394769 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:00.394769 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 263/536] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:00.400158 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:00.405122 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:00.427370 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:00.542697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6aa4cab-b3c6-4264-adb2-a8bc9f151b2a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:00.579926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:00.580602 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:00.580891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:00.581177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:00.582018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=835467295bfb4450a64d06c813a360e4) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:00.582337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:00.583964 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:00.595797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 274/537] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:00 2022] GET /identity/v3/role_assignments?user.id=835467295bfb4450a64d06c813a360e4&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:00.632556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619853a-bde0-48fc-8412-0d1eecb8dd8c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:00.674433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:00.675650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:00.676452 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:00.677224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:00.678476 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:00.679329 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:00.681859 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:00.697426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 264/538] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:00.703300 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:00.826316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:00.855709 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e956dc-d94d-4bc6-afee-7ccaff8e2a79 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:00.902280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:00.903549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:00.904319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:00.904708 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:00.913742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:00.915454 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:00.934656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:00.935589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:00.936463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 275/539] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:00.943467 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:01.044243 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:01.083374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16562ce-c0b8-4949-b9b1-1794439dabfb None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:01.135558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:01.136271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.136555 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.136835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.137635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:01.137946 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:01.139398 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e3f47d-eb3e-49d8-b396-cbfca0cf6820 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:01.153306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 265/540] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:01.161493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:01.209584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d7bba-365e-4383-8ec1-724004e6ddc7 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.209913 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d7bba-365e-4383-8ec1-724004e6ddc7 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.210200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3d7bba-365e-4383-8ec1-724004e6ddc7 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.212520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 266/541] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:01.225321 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.225616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.226015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.257177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:01.258606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:01.336930 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d2f67a-2b38-40f4-b72b-389365f851ff None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:01.411788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 267/542] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:01.419115 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:01.419894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.420219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.420539 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.421494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=8eca2578e831457bafe0312ca5f875fe) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:01.421854 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:01.423504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b776b8-4e50-44f8-840c-eaefd92bfe0d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:01.433363 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:01.438285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:01.448223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 276/543] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:01 2022] GET /identity/v3/role_assignments?user.id=8eca2578e831457bafe0312ca5f875fe&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:01.548602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:01.549010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ade7a0-9183-4848-a7f1-a83a21b9d0e7 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.549301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ade7a0-9183-4848-a7f1-a83a21b9d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.549580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ade7a0-9183-4848-a7f1-a83a21b9d0e7 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.551281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 277/544] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:01.561324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.561661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.561879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.589514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:01.590690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:01.617168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e4f955-8087-46f7-9128-89450695fb41 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:01.705284 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 278/545] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:01.719705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:01.720882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.721323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.721749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.741700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:01.744656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:01.749672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:01.750570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:01.752546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:01.753195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 268/546] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:01.760839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:01.912201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4aa981-5081-40e1-8271-1f5a32d8ac13 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:01.932146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27242f8b-6d4a-49f0-82f4-8b89cfe6ee07 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:01.956193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:01.985890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:01.988653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:01.989361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:01.989652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:01.989934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:01.990713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:01.991123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:01.992608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:02.002742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 269/547] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:02.005092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:02.006042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.006433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.006926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.008532 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:02.038070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:02.052538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:02.053594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:02.054991 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 279/548] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:02.078495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:02.188898 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ed18b9-8fec-4978-b2ca-07d98ffd6946 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:02.233675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:02.234595 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.234897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.235270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.253014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:02.254737 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:02.281341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:02.283540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:02.286031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:02.286031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:02.286031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:02.286031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:02.286031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 270/549] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:02.290672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:02.376652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:02.411182 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da162f8-632a-4e0b-9865-b82052affd16 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:02.470552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:02.471945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.471945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.472624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.475289 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:02.475289 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:02.478623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:02.491879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 280/550] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 414 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:02.501229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:02.530248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23931d17-e0fa-44a1-817e-2eb000f90047 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:02.583340 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:02.586016 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.586755 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.588658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.589983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:02.591074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:02.593903 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:02.614820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:02.617509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 271/551] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:02.630763 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:02.705789 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6bb916-4fcc-457c-9471-72320458d242 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:02.785700 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:02.786437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.786715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.789294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.807552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:02.809507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:02.830210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:02.831276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:02.832272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:02.832272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:02.832272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:02.832272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:02.835829 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 281/552] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:02.845121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:02.849157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:02.856765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59c994-6792-4065-a3ed-819936933f61 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:02.900014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:02.901071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.901353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.901625 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.910676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:02.912825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-00611154-fe0c-4370-8e39-1d0a081818a7 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:02.932205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:02.933248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:02.934195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 272/553] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:02.935444 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3cb87-2ac6-43d6-90cb-55e1954fbf5b None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:02.935444 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3cb87-2ac6-43d6-90cb-55e1954fbf5b None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:02.935706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e3cb87-2ac6-43d6-90cb-55e1954fbf5b None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:02.944214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 273/554] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:02 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:02.945170 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3cb87-2ac6-43d6-90cb-55e1954fbf5b None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.006459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2571a10-f528-471f-a5a5-fb880eff8b87 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.009273 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.052074 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.053102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.053642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.054076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.054952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:03.055427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.057233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3285e610-3040-42fe-80a5-bedb5c6c3ba2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.061511 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e3cb87-2ac6-43d6-90cb-55e1954fbf5b None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.076734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 282/555] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:03.078629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.079675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.080127 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.098306 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:03.100015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:03.101160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.101899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.102181 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.102458 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.103354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:03.103705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.105261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.132042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 274/556] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 17 07:14:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:03.133141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.149067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.185581 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 283/557] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:03.192758 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.251367 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a074349-fe92-4c89-b8cf-a4b5f9275c43 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.290887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.291691 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.292011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.292288 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.300934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.302574 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.316935 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:03.318171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:03.319785 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:03.321230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:03.322981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 275/558] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:03.325453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.330290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4c60d-f69a-40ed-805d-f7c2ad67c981 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.369677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce689bc7-77c0-44ec-8dba-31a27bf1f1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.370634 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce689bc7-77c0-44ec-8dba-31a27bf1f1ba None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.371081 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce689bc7-77c0-44ec-8dba-31a27bf1f1ba None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.371501 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce689bc7-77c0-44ec-8dba-31a27bf1f1ba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.412797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.448506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d561af-9a57-47d1-8329-d05740782e90 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.450669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce689bc7-77c0-44ec-8dba-31a27bf1f1ba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.452178 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce689bc7-77c0-44ec-8dba-31a27bf1f1ba None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.492871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.493710 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.494062 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.494283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.507480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:03.516641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:03.517756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 276/559] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:03.518716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.586505 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.597560 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 284/560] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:03.598935 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dd3c-cc69-4ec3-902f-2adef5b0b606 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.599298 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dd3c-cc69-4ec3-902f-2adef5b0b606 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.599657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d00dd3c-cc69-4ec3-902f-2adef5b0b606 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.601340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 285/561] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:03.604898 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dd3c-cc69-4ec3-902f-2adef5b0b606 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.637234 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294927c3-4cd7-47a9-9fcf-685560203969 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.670893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.679093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.679787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.680087 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.680363 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.681322 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:03.681747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.683223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.703948 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 277/562] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:03.709330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.724655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d00dd3c-cc69-4ec3-902f-2adef5b0b606 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.768848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.769667 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.770024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.770376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.772367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:03.772823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.774696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4f87af-2966-47b3-8a59-949085c23d84 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.785548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 286/563] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:03.786835 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.787125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.787407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.810660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:03.811920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:03.839333 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa45841b-7d4b-43c1-ab34-3ccfdc8a2785 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:03.869888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:03.881974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07144337-dc99-455a-bbda-1966573b422f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:03.882996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144337-dc99-455a-bbda-1966573b422f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:03.883326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144337-dc99-455a-bbda-1966573b422f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:03.883551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07144337-dc99-455a-bbda-1966573b422f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:03.899850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 287/564] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:03.899850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.907796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07144337-dc99-455a-bbda-1966573b422f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:03.910102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07144337-dc99-455a-bbda-1966573b422f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-07144337-dc99-455a-bbda-1966573b422f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:03.931139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:03.932372 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:03.933262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:03.933262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:03.933262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:03.933262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:03.933262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 278/565] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:03.934257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07144337-dc99-455a-bbda-1966573b422f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:03.985557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.034155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a017f03a-51aa-4820-900f-3d188e4bd495 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.064871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07144337-dc99-455a-bbda-1966573b422f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.088683 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.089549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.089772 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.090054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.102188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.103662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.104826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.105636 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.105925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.106210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.117066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.118576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:04.128932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:04.129863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:04.130737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:04.130737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:04.130737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:04.130737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:04.130737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 288/566] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:04.131036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:04.136579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:04.137673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:04.138764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:04.138764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:04.138764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:04.138764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:04.138764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 279/567] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:04.138764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.181020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.246467 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa431dd-d762-49e0-a8c6-fe980b588fde None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.246723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.257454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072397ec-5884-43a0-9e8c-6f9b96642b4d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.283630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1912a069-1bc6-4e1d-91e1-9c34f2b6a89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.284472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a069-1bc6-4e1d-91e1-9c34f2b6a89e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.284760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a069-1bc6-4e1d-91e1-9c34f2b6a89e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.285028 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1912a069-1bc6-4e1d-91e1-9c34f2b6a89e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.292578 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.293244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.293529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.293808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.294525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:04.294837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.295269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1912a069-1bc6-4e1d-91e1-9c34f2b6a89e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:04.296245 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-1912a069-1bc6-4e1d-91e1-9c34f2b6a89e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:04.303091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:04.304060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:04.305365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 289/568] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:04.306605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e552-8a0b-482e-85f0-ab4ac2ccf329 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.306605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e552-8a0b-482e-85f0-ab4ac2ccf329 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.306605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4386e552-8a0b-482e-85f0-ab4ac2ccf329 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.307863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 290/569] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:04.311455 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e552-8a0b-482e-85f0-ab4ac2ccf329 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.311615 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 280/570] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:04.311615 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.415703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda367f3-dba3-4c34-a3ef-28cfe16b8479 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.427337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.432600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4386e552-8a0b-482e-85f0-ab4ac2ccf329 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.453711 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.455064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.455345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.455617 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.456674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:04.456978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.458357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.470328 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.470880 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 281/571] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:04.471036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.471537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.471537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.472069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.472395 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:04.472714 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.474110 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e91285-c0b5-4592-a615-fb837f8bbd0d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.489689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.496198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 291/572] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:04.497579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.497877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.498164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.516130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:04.517976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:04.591277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 292/573] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:04.592546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.596394 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c899b5e-d071-44f3-b764-d5082a4eceb4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.639343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.640082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.640358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.640629 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.641953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:04.642253 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.643665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.660161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 282/574] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:04.661088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.700929 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.714820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3226e51-cdc6-4853-b7e2-57f68b9a962b None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.753407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.755928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.756752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.757041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.757319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.764983 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.766479 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.778142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e190d61-7278-4f68-b522-e50ed9ad940d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:04.780919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:04.781877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:04.782795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 293/575] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:04.783304 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.817674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.818487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.818774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.819053 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.827279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.828778 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:04.843653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:04.844827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 283/576] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:04.846101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.894518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d0b58d-7058-49c3-a8d2-0cc2fb64558a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.931199 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:04.932464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:04.933118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:04.933509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:04.941932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:04.943396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:04.958140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:04.959291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 294/577] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:04.960463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:04.963008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a28b021-686f-436a-80e5-adf454176bb2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:04.971781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:04.999377 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.000214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.000501 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.001419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.003434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.015543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:05.023297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:05.024276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:05.025115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 284/578] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:05.025788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.069662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add5db6d-1a9d-44cb-834a-58e36fb05f17 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.103223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.104039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.104325 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.104607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.117781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.119241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:05.139514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:05.141011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:05.143331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:05.143331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:05.143331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:05.143331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:05.143331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 295/579] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:05.143331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.147324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33430461-86d0-49c2-8dff-dd52d178deec None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.188582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.189250 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.189535 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.189813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.190603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:05.190916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.192417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.207488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 285/580] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:05.208463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.224946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.270089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dda4e8d-338f-456e-89d0-8ccccc63f472 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.273436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.314403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.315095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.315374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.315652 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.316542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:05.316853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.318310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.320980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894123e0-76e4-4cc0-851d-181bd89b408f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.337090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 296/581] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:05.338016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.365788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.366664 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.367082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.367472 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.368720 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:05.369156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.370701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.383706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 286/582] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:05.384606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.443165 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e879430f-2327-43ce-b3ee-26bd8ed0ea69 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.461522 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.488095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.488793 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.489079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.489353 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.490120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:05.490428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.491820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.507543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 297/583] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:05.507543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.509862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafde32d-3481-424d-89bf-78a60b6cee7e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.524726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.550064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.551123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.551583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.552070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.553236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:05.553603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.556005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.569456 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 287/584] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:05.570324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.626382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10301779-3720-46db-a52f-348d2de23cc5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.662903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.663564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.663897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.664242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.665085 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=85359b608acd4054af1ef3ea85f3e271) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:05.665406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.666825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.672907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 298/585] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/role_assignments?user.id=85359b608acd4054af1ef3ea85f3e271&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:05.673696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.679140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923c236c-b0bf-4efb-846f-6d7fbbde5ac3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.731093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.731884 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.732177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.732459 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.746821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.749611 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.750286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:05.780933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:05.781902 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:05.782777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:05.782777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:05.782777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:05.782777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:05.789597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 288/586] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:05.789597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.819535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad84706f-9ead-498e-afc1-0dab07eff4af None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.828211 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:05.871599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.873428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.873843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.874124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/4f968a9c3d3d4dbfb71216af67cd291e/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.898381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=4f968a9c3d3d4dbfb71216af67cd291e, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.900903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:05.924536 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 299/587] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:05 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/4f968a9c3d3d4dbfb71216af67cd291e/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:05.924536 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:05.936494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8430b47a-0010-4832-8d63-b509f90d7615 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:05.980604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:05.981520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:05.981905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:05.982190 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:05.995501 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:05.997188 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:06.019509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:06.020495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:06.021357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:06.021357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:06.021357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:06.021357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:06.021357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 289/588] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:06.021899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.077903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:06.086540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36ed57d-cff7-4725-96ed-a795a9f9b7cc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.143290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:06.143517 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.144339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.144640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.144923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.168413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.168413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:06.184843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:06.185877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:14:06.186803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:06.187426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5f32b-103d-420c-9988-70c7fdd95d41 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.189486 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 300/589] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:05 2022] GET /identity/v3/users/cinder => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:06.190561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.235963 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.236563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.236848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.237126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.237849 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:06.238157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.239599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.253597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 290/590] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:06.259807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.332890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e456b1a-327b-470a-826f-170daeca9d43 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.369587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29603dee-41f9-4a23-bc0c-d9076d0d10ef None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.383667 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.385338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.386034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.386555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.387542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:06.388201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.389918 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.413930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.413930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.413930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.413930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.414491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:06.414491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.414491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.415511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 301/591] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:06.417394 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.431988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:06.439728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:06.446360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 291/592] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:06.447732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.558899 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c544719-927e-4417-bab3-7e68f4c4e1ea None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.590577 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b00a53f-bb79-4cb5-b082-84b1236537ac None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.606570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.607891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.608184 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.608511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.618447 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.620656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.636380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.637912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.638549 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:06.638770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:06.640599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 302/593] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:06.642406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.643649 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.652619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.654990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:06.672086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:06.673176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:14:06.674128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:06.678767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 292/594] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/users/neutron => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:06.680555 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.744903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:06.767955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:06.788872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc3e17-4c05-46ec-bb04-4365790191d0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.836024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.838246 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.838683 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.839123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.846538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b65b34-04a2-412f-bbcc-661f2cb2235b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:06.854404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.856117 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:06.878474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:06.879562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:06.880633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:06.880633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:06.880633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:06.880633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:06.882977 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 303/595] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:06.884102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:06.918450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:06.919606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:06.920093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:06.920550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:06.921561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:06.922029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:06.925071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:06.942672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 293/596] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:06.943851 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.065776 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d59d10c-c8f8-45f1-b58a-ccb00cb4a658 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.072562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972560cc-8952-4b5b-8459-456e22916af1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.085096 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:07.108473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.109428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.110401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.110932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.111893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:07.112381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.113948 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.123795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:07.132098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 294/597] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:07.132976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.142977 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.144451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.145221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.145952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.147844 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:07.148664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.164327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.197547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 304/598] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Jun 17 07:14:06 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:07.198540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.258814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47a688-d7c0-465a-9abc-af6be5142577 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.309188 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.310125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.310643 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.310925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/0d6a4b1519b0433898a4b04bec38722b/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.321605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8ad4c3-dfeb-430a-a97f-c9ba4df66482 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.331980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=0d6a4b1519b0433898a4b04bec38722b, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.334316 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.353404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 295/599] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:07 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/0d6a4b1519b0433898a4b04bec38722b/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:07.353937 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.374077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.374932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.375221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.375503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.387506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:07.391415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.396035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:07.431722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:07.432755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:07.435047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 305/600] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:07.439618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.476142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1205a782-0b7b-49b6-994f-c23276760336 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.524732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.525577 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.525861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.526146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.553107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.556609 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.557436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:07.606098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:07.607060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:07.608509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:07.608509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:07.608509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:07.608509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:07.611258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 296/601] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:07.617465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.637666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8ffb2d-987d-4f81-a1be-be76eba8becd None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.684225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.684908 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.685202 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.685486 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.686298 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:07.687245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.688792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.706084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 306/602] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:07.712761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.737538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:07.784226 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b47b64-a592-4a5d-b160-21f989134890 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.853571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.854446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.854773 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.855060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.855901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:07.856307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.857813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:07.874071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 297/603] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:07.881498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:07.911258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c124be-6763-47c4-92dd-0e804f82a989 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:07.933844 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:07.962617 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3c7b6f-7005-43dc-9e6f-57b4a53b2a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:07.963532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7b6f-7005-43dc-9e6f-57b4a53b2a66 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:07.963867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7b6f-7005-43dc-9e6f-57b4a53b2a66 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:07.964158 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3c7b6f-7005-43dc-9e6f-57b4a53b2a66 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/835467295bfb4450a64d06c813a360e4/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:07.980206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7b6f-7005-43dc-9e6f-57b4a53b2a66 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=835467295bfb4450a64d06c813a360e4, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:07.981796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3c7b6f-7005-43dc-9e6f-57b4a53b2a66 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:08.007853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 307/604] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:07 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/835467295bfb4450a64d06c813a360e4/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:14:08.124396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7ed603-6aae-4aae-af60-74ec6baa0be2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:08.184012 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:08.185162 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.185563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.185950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.192054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc96c0-1fb5-461d-944a-9ed81192d93a None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.192364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc96c0-1fb5-461d-944a-9ed81192d93a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.192625 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cc96c0-1fb5-461d-944a-9ed81192d93a None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.194343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 308/605] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:08.198012 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:08.199978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.200225 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:08.200706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.201289 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.206017 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:08.229670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:08.231341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:08.232854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:08.233543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:08.234551 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:08.239570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 298/606] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:08.250641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:08.340749 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 309/607] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:08.377052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:08.391693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad6401-accd-433f-aeba-d16283f1a294 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:08.460552 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:08.461235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.461621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.461907 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.462720 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:08.463036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:08.464537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd94eb16-f27b-4298-bc77-69aefe69eddb None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:08.480885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 299/608] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:08.482281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604593-3b28-4444-a1e3-8ca5cbe8b0ae None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.482580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604593-3b28-4444-a1e3-8ca5cbe8b0ae None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.482854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4604593-3b28-4444-a1e3-8ca5cbe8b0ae None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.484538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 300/609] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:08.489442 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604593-3b28-4444-a1e3-8ca5cbe8b0ae None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:08.544017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:08.564179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c3f0c5-ae13-42ea-8137-fe0a7cbc01a9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:08.571631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:08.613700 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08937a79-6e61-4d8d-a975-7ef6940b497a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:08.614524 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08937a79-6e61-4d8d-a975-7ef6940b497a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.614872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08937a79-6e61-4d8d-a975-7ef6940b497a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.615439 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08937a79-6e61-4d8d-a975-7ef6940b497a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.632835 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08937a79-6e61-4d8d-a975-7ef6940b497a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:08.640123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4604593-3b28-4444-a1e3-8ca5cbe8b0ae None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-08937a79-6e61-4d8d-a975-7ef6940b497a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:08.643555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:08.644624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:08.645457 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:08.654349 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 310/610] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:08.656094 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.656545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.657032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.686858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:08.688375 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:08.711016 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:08.712922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.713310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.713687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/8eca2578e831457bafe0312ca5f875fe/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.735294 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=8eca2578e831457bafe0312ca5f875fe, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:08.738154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:08.755904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 301/611] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:08 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/8eca2578e831457bafe0312ca5f875fe/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:14:08.757247 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:08.788635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 311/612] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:08.827807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:08.934541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:08.947791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a466924-3284-4519-8e78-7c6b8133887a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:08.954422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:08.977290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0d385e-7064-417b-90d9-aa7b03b5d2a7 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:08.992252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:08.992957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:08.993246 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:08.993523 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:08.994444 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:08.994758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:08.996262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.007046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 302/613] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:09.013299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.031535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.032922 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.033459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.034015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.050588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:09.059290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:09.060319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:09.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:09.064839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 312/614] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:09.070342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.132249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e243be-0820-46d1-be90-7caf72a37abf None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:09.202972 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.203856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.204143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.204418 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.219453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:09.221814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:09.253326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:09.254240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:09.255148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:09.255148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:09.255148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:09.255148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:09.255148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 303/615] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:09.261932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.281677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6c7d71-42eb-44b7-8978-1a1b35bba236 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:09.325742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.326808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.327301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.327805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.328832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:09.329379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:09.330970 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.333295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:09.341345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 313/616] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:09.342040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:09.346697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.466397 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842d3fca-3348-43f3-8736-c6d5c460b17c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:09.506510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.507658 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.508212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.509144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.521998 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:09.524198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.536777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5528cd8-6cbb-4d10-8e8d-c25021ff04ac None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:09.544916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:09.545813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:09.546722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:09.546722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:09.546722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:09.546722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:09.549110 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 314/617] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:09.561181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.592541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.593701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.594252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.594749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.596165 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:09.596718 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:09.599206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.636795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 304/618] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:09.641134 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.684245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:09.781260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6c9c51-6627-41fd-8948-ac50b584846d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:09.825830 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:09.840116 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.840851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.841138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.841415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.842151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:09.842460 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:09.843851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.861378 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 315/619] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:09.866591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c710976-317f-406b-a9b1-9029500480ad None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:09.868947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:09.923029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:09.923899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:09.924240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:09.924519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:09.933696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:09.936750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:09.953489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:09.954534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:09.955491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 305/620] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:09.963494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:10.102098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da36d25c-64b0-4b8b-8634-cc5d568a7063 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.112003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb1fec1-b4bc-4f38-a702-905f4fddd113 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.122311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:10.164171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.167928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.168303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.168536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.169341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:10.169656 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:10.180638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:10.187252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:10.191493 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 306/621] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:10.198918 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:10.200508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.201332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.201628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.201885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.222978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:10.226609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:10.253760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:10.254753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:10.255682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:10.262776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 316/622] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:14:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:10.267846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:10.391256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e112ef5-698b-4e4b-826f-c0bf70ee6508 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.438344 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.439155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.439447 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.439728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.441377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f1df13-a7a1-43ab-af66-535620633b93 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.453474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:10.455564 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-8093aedc-2829-47c7-9264-d781fc6ea977 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:10.482908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:10.484586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:10.486719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:10.486719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:10.486719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:10.486719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:10.489583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 307/623] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:10.491863 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eb787-591c-4291-9017-3c83385cd41f None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.492316 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eb787-591c-4291-9017-3c83385cd41f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.492740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7eb787-591c-4291-9017-3c83385cd41f None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.495700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 308/624] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:10.497073 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7eb787-591c-4291-9017-3c83385cd41f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:10.497610 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.498519 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.499000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.499518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.500650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:10.501180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:10.502810 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed784dc-d50c-48cf-9f33-e2c9e85c5014 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:10.522710 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 317/625] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:14:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:10.524744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.525252 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.525748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.545485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:10.547005 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:10.572538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:10.580506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:10.639214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7eb787-591c-4291-9017-3c83385cd41f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.641255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 318/626] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:10.642347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:10.688502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.690026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.690579 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.691138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.692253 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:10.692849 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:10.694722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:10.709405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 309/627] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:10.710757 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:10.787797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c444be2c-6256-4627-8a9e-d0ada32fb3a8 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.829384 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44ab02-0502-4d83-b130-11d33b2d2707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.830477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44ab02-0502-4d83-b130-11d33b2d2707 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.830969 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44ab02-0502-4d83-b130-11d33b2d2707 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.831638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44ab02-0502-4d83-b130-11d33b2d2707 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.859058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:10.882331 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74945ae-7a2f-4595-bdfb-a0753647c1e6 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:10.898177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:10.915796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44ab02-0502-4d83-b130-11d33b2d2707 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:10.918643 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44ab02-0502-4d83-b130-11d33b2d2707 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:10.933821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:10.934955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:10.935450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:10.935952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:10.948395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:10.956876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:10.957841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:10.958775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:10.961642 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 310/628] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:10.962858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.038704 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 319/629] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:11.040467 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d589f-04c3-4439-a129-dc88eceec3d9 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.040899 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d589f-04c3-4439-a129-dc88eceec3d9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.041316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662d589f-04c3-4439-a129-dc88eceec3d9 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.043346 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 320/630] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:11.048650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d589f-04c3-4439-a129-dc88eceec3d9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.078678 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1860f54e-50ca-4542-9e53-1bf419ea6238 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.114790 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.115598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.115913 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.116193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.123520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.124558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.125060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:11.141852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:11.142869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:11.143783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 311/631] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:11.144290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.188388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.189570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662d589f-04c3-4439-a129-dc88eceec3d9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.229958 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.230927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.231228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.231527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.232946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:11.233376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.235352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ba0e8-196a-41fb-b120-891f45879d75 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.244294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 321/632] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:11.245668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.245977 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.246242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.264580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:11.265800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:11.284691 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3c7b8-f1f8-4a54-aea6-cf962e72c91b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.330468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.331825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.332120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.332402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.343865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.345892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.353288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 322/633] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:11.354145 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:11.365638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:11.367079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:11.369093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:11.369093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:11.369093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:11.369093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:11.369093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 312/634] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:11.369093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.426506 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.464117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.480561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98974c-ec88-45b9-a434-0271276f1199 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.488544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6562b2e4-3a35-4ef1-82e1-132db549c9e7 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.515318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.516721 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.517010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.517289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.525164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.525842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.526124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.526403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.527207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:11.527519 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.529213 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.529369 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db67b1cc-1db5-4940-ae06-2368ce4c8bb8 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.531019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.543449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 323/635] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:11.544806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739e5f-b8d6-46ca-8088-c4bc54636b56 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.545096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739e5f-b8d6-46ca-8088-c4bc54636b56 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.545368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54739e5f-b8d6-46ca-8088-c4bc54636b56 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.546755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 324/636] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:11.548569 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739e5f-b8d6-46ca-8088-c4bc54636b56 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:11.551345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:11.552272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:11.553161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:11.553161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:11.553161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:11.553161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:11.557086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 313/637] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:11.557892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.667228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54739e5f-b8d6-46ca-8088-c4bc54636b56 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.667815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7688aed6-4672-4958-b050-3cb664ee3da6 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.676723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.701921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.702597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.702886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.703163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.703268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.704463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:11.704613 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.704774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.704873 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.705046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.706179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81cb379-9223-431f-a1a5-c99aa6925202 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.713636 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.717230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:11.724795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 325/638] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:11.726069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:11.726327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:11.727278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:11.728174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:11.728819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.728819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.728949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 314/639] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:11.729794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.752909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:11.754155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:11.830051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 326/640] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:11.830910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.850528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a55e62-62d9-48ee-80fe-6e00cd5fc324 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.891981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.892880 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.893156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.893429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/85359b608acd4054af1ef3ea85f3e271/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.909156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=85359b608acd4054af1ef3ea85f3e271, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.910603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.924826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 315/641] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:11 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/85359b608acd4054af1ef3ea85f3e271/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:11.925686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:11.935177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:11.941572 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c068d-12b4-4c45-bf06-9c8951136d98 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:11.981900 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:11.982856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:11.983317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:11.983753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:11.984754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:11.985256 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:11.986834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:11.995603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.001174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 327/642] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.002295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.072116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15360208-94d2-42e9-9b4d-f053abc83f43 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.115944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.116761 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.117050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.117381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.124658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.126700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.127530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ad46f-7716-48e7-ab1e-6673e74fbd9a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:12.141782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:12.142788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:12.143692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 316/643] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:12.144213 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.177495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.178348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.178921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.185715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.185715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:12.185715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.185715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.195818 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 328/644] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.196898 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.221676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.266687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beafafa0-ba5d-46b3-a8b4-4fa19e87093a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.274435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.304470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.305282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.305570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.305853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.315744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e057f7e0-2b0c-42f1-b44d-89c18a46fd16 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.317105 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:12.324875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:12.325995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 317/645] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:12.327388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.354895 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.355706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.356025 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.356310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.365044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.366600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:12.394427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:12.395448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jun 17 07:14:12.396500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:12.403105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 329/646] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/users/glance => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:12.404688 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.455362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e7e66f-aeb9-4feb-a2fa-3a2c4f7b38a7 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.499557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.500314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.501127 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.501417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.502212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:12.502529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.504023 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.504707 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.517469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 318/647] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.518137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.530371 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407814f-f023-445a-a168-5f39dba89086 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.546392 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.569840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.570990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.571279 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.571554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.582612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.584113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:12.604443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:12.605875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:12.606794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:12.606794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:12.606794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:12.606794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:12.606794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 330/648] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:12.606794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.633446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6749536a-a9da-4925-8b26-abc1bda0ab49 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.673829 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.674515 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.674803 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.675087 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.677399 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:12.677399 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.677593 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.687798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 319/649] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.687798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.728233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501d467-0cb8-49f5-a786-a908d1658768 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.764521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.771714 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.772741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.773226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.773786 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.774941 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:12.775247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.776691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.803792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 331/650] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.803792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.808381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:12.823056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23886500-0dd7-4b71-8885-b16625a9536a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.866406 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.867074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.867360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.867639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.868496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=4f968a9c3d3d4dbfb71216af67cd291e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:12.868814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.870248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.883807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 320/651] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/role_assignments?user.id=4f968a9c3d3d4dbfb71216af67cd291e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.883807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:12.919915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417bb95a-420a-4bcc-ab45-cc4feafa9072 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:12.962544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:12.963389 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:12.963739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:12.964144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:12.965156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:12.965656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:12.967255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:12.984542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 332/652] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:12.985570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.007939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea5de8a-0027-457e-a8c1-d6409c0c5c69 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.048754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.058953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.060082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.060446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.060791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.079217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.081315 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:13.106222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:13.107343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:13.112792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:13.112792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:13.112792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:13.112792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:13.112792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 321/653] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:13.112792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.116032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.130498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22adcc2-b051-4891-a34c-815398d635ad None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.178921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.180974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.180974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.180974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.262376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.264014 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.266431 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a46947-bef9-43e9-8313-d5a8d3ccfca9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.313678 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963858-1446-4287-933e-bc0458913311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.314572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963858-1446-4287-933e-bc0458913311 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.314919 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963858-1446-4287-933e-bc0458913311 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.315261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f963858-1446-4287-933e-bc0458913311 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.320853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.324553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963858-1446-4287-933e-bc0458913311 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.326546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f963858-1446-4287-933e-bc0458913311 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7f963858-1446-4287-933e-bc0458913311 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:13.347151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:13.348938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 322/654] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/users/cinder => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:13.350686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963858-1446-4287-933e-bc0458913311 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.382641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 333/655] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:13.383521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.432781 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.476221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f963858-1446-4287-933e-bc0458913311 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.504084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53035f2-0e7f-4f50-a9ef-aa8544b71009 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.514504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.515450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.516464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.516967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.517843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:13.518302 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.519976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.534501 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 323/656] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:13.535670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.545812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.546726 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.547539 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.548007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.549619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:13.550103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.552253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.581799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 334/657] 10.222.0.58 () {56 vars in 1137 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:13.582933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.596927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.670362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9c8c5b-4f50-4fbd-81bf-c122cc068748 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.703709 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509a83e5-b5a8-43ef-8324-ade1990279bb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.704756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.717933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.718760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.719075 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.719350 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.730119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.731773 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:13.751260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:13.752276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:13.753193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:13.753193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:13.753193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:13.753193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:13.753193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 324/658] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:13.753894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.755030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.756133 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.756901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.758742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.768631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.771099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:13.793122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:13.794181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jun 17 07:14:13.795141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:13.799059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 335/659] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/users/neutron => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:13.800106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.872261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2376cb48-728b-40f1-af81-aabbb8005b7f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.877332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.911706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.912505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.912861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.913210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.914666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f79322b-a7fa-431b-b09b-689db88f6045 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:13.951593 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:13.952711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:13.953220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:13.953729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:13.954670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:13.955179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.956806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:13.965016 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:13.971124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 336/660] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:13.972244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:13.991207 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:13.992916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.075586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d871e20-ff01-4ad3-bb11-63fc2dfc15c2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.099430 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 325/661] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:14.100371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.116326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.130920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.133022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.133703 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.134373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.136009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:14.136761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.139299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.181206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 337/662] 10.222.0.58 () {56 vars in 1139 bytes} [Fri Jun 17 07:14:13 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:14.182860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.192070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.220613 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d810470c-8597-4b76-83e1-09e43c6e5589 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.270278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.271488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.271951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.272368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.283268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.285559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.301776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f742dd33-7031-462d-9364-cc98892a5da3 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-e68960ce-95b2-47c6-864a-2c49fa64adb5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:14.308339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:14.310310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:14.311930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 326/663] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:14.312429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c75dc-d056-4ada-81ff-2e7822cd1ba6 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.312429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c75dc-d056-4ada-81ff-2e7822cd1ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.312840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4c75dc-d056-4ada-81ff-2e7822cd1ba6 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.315817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 327/664] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:14.316191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c75dc-d056-4ada-81ff-2e7822cd1ba6 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.351583 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.352630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.353180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.353537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.366390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.368183 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:14.391483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:14.392507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:14.393391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:14.393391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:14.393391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:14.393391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:14.394066 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 338/665] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:14.395890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.425945 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4c75dc-d056-4ada-81ff-2e7822cd1ba6 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.440473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.463824 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.464487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.464771 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.465046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.470250 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.508095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153fe97e-69e6-41fb-9fe7-c5dff79184d4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.535034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.536550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.545608 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.546397 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.546685 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.546981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.547932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:14.548250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.549675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210f2c8a-0411-4e44-9b5a-45e8c4bedcf1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.564651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 339/666] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:14.565979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.566274 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.566554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.584280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:14.585647 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:14.642298 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 328/667] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:14.643173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.662122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 340/668] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:14.663267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.694925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.698903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.774646 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fecb171-eb61-46cd-a127-fbd916c8eb68 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.779039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92468cf7-3320-4242-aeb1-f173526db527 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.816902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.817570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.817857 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.818136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.818984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=0d6a4b1519b0433898a4b04bec38722b) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:14.819298 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.820756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.827120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 341/669] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/role_assignments?user.id=0d6a4b1519b0433898a4b04bec38722b&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:14.828172 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.842343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:14.843534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:14.843877 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:14.844206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:14.844957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:14.845271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:14.846689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:14.868436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 329/670] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:14.868436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:14.949046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.960308 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50cb551-105d-4893-ad42-8f93cca38227 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:14.986125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:14.993173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aac44f5-c8e1-4c54-b449-77341cff5473 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.003496 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.004769 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.005259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.005738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.019470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.021413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.037415 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.038233 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.038726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.038929 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:15.041774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:15.042662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:15.043554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:15.043554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:15.043554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:15.043554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:15.048239 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 342/671] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:15.048730 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.053934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:15.061159 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:15.062121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:15.063462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 330/672] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:15.065194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.185207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb99b14-0804-4ada-ac15-1798c94832ba None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.191284 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617d29e9-345a-4a41-a688-54603db51adf None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.226697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.227272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.227650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.227895 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.228587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:15.228898 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.230323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.235577 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.236697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.237201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.237681 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.247917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 331/673] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:15.247917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.253063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.255204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:15.275001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:15.276018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:15.276902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:15.277358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:15.283805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 343/674] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:15.283805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.289770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:15.380765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d617f52-8f73-42a0-b94e-34366f4c5e1c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.411666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8061a-f09b-44d0-86e7-1aa8db48b9a4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.419586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.420290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.420575 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.420854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.421611 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:15.421923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.423881 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.436821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 332/675] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:15.436821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.452278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.453082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.453402 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.453680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.461199 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.462247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d86f0f1a-1bc3-4444-bf78-99d485f31506 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:15.476341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:15.477696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:15.478598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 344/676] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:15.479079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d10a78-ca9a-47f1-a38a-a5bc5b4fb40a None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.479146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d10a78-ca9a-47f1-a38a-a5bc5b4fb40a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.479692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d10a78-ca9a-47f1-a38a-a5bc5b4fb40a None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.483807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 345/677] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:15.483807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d10a78-ca9a-47f1-a38a-a5bc5b4fb40a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.530019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:15.554254 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:15.555276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0dcc8a-a0e3-4287-8734-3e44785083fc None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.592697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.593519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.594348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.594639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.595433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:15.595753 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.597220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.604677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d10a78-ca9a-47f1-a38a-a5bc5b4fb40a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.616140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 333/678] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:15.617419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.651409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.653000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.653294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.653827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.668257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.669979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-2fc129b7-fca2-4012-9c49-3630456f4de7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:15.694297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:15.695259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 346/679] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.701862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.714952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:15.716181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:15.733229 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672de267-4fdd-4218-8288-1470fba584b4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.772283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.773063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.773345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.773619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.774395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:15.774703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.776396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.784632 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:15.787511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 347/680] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:15.788523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.804998 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 334/681] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:15.805195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.842989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:15.899200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953e0357-80e1-47ee-b90f-60bf1272bad3 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.915868 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5e696b-d610-4b5b-8ee0-d1857f11f299 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:15.939228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.939922 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.940208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.940480 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.941309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=835467295bfb4450a64d06c813a360e4) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:15.941618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.943091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:15.950068 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 348/682] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/role_assignments?user.id=835467295bfb4450a64d06c813a360e4&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:15.951118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:15.978554 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:15.979238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:15.979524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:15.979942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:15.980798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:15.981115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:15.982537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:16.008675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 335/683] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:16.008675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.089967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.105067 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b3ed5-9193-4bc9-9cff-50a33a40de61 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.119904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.152791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c3c896-9bfa-45e0-8b21-a4a0f0e6b71a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.159271 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.160029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.160320 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.160646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.161501 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=8eca2578e831457bafe0312ca5f875fe) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:16.161820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:16.163241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:16.173144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 349/684] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:15 2022] GET /identity/v3/role_assignments?user.id=8eca2578e831457bafe0312ca5f875fe&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:16.174384 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.201187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.202026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.202317 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.202601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.224795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:16.232936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:16.235014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:16.236941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 336/685] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:16.245626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.310850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336d90ce-1b8e-48de-a058-8cf99f22ed93 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.354421 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.355247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.355531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.355842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] PATH_INFO: `/v3/users/swift` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.367111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:16.368776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:16.388350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:16.389356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:16.390601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 350/686] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:16.405340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.416202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e69e6e-941d-46e0-8bdc-50c4db128d91 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.440501 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.458341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.468313 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.469856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.470348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.470827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.471794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:16.472309 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:16.473877 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:16.484218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 337/687] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:16.490412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.543365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c54f7f-cb3a-4fd2-b963-85682cd04dba None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.582886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.583487 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.583785 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.584075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.584925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:16.585239 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:16.586679 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:16.608800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 351/688] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:16.614886 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.620315 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a83cf2-c282-4856-badb-b988803d3f53 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.688449 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.689258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.689538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.689814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.710576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:16.712083 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:16.736774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:16.737725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:16.738607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:16.738607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:16.738607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:16.738607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:16.738607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 338/689] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:16.744888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:16.802557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.811984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:16.820669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19256217-f6d0-430f-ab5f-ac92b7386f3b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:16.898686 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:16.899455 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:16.899741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:16.900040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:16.954443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60c2a93-8fcf-400a-bc06-7b333040d577 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.016975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.018448 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.027930 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.031716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.032036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.032320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.033050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:17.033361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.034742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.060173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 339/690] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:17.066379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:17.208388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:17.225308 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 352/691] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 611 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:14:17.237243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:17.260069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:17.276905 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9339616a-fbb5-4387-8d3c-00e4b0a3df97 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.344901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.345817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.346108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.346387 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.361953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.363429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.392379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45988088-9308-4bfa-a79f-89b3d20c8f4b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:17.393912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:17.395817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:17.396787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 340/692] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:14:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:17.409466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:17.460565 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.461740 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.462247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.462739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.481782 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.483544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:17.502023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:17.502987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:17.503944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:17.503944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:17.503944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:17.503944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:17.506317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 353/693] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:17.511941 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:17.562735 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84e7b8-3e34-41fa-8942-92437f6f60a5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.603213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:17.623160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.624300 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.624753 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.625750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.627069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:17.627656 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.630180 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aeed2fc-dbb2-45d9-b20e-674c594635d6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.658280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 341/694] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:14:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:17.662148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ff5674-6969-4ddb-9717-d67a4748dec1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.666004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a7a7-e122-44b1-9bab-4bc217fd338f None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.666458 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a7a7-e122-44b1-9bab-4bc217fd338f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.666882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e36a7a7-e122-44b1-9bab-4bc217fd338f None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.669506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 342/695] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:17 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:17.672675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a7a7-e122-44b1-9bab-4bc217fd338f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:17.697842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:17.703267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.704127 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.704410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.704681 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.705406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:17.705716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.707074 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d0b14e-e58d-45d3-8664-6ded93fa182b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.719930 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 354/696] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:17.721310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.721587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.721864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.738636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:17.739853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:17.800212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e36a7a7-e122-44b1-9bab-4bc217fd338f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.816016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 355/697] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:17.816954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:17.840726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.841568 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.842766 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.843057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.867028 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:17.934993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:17.936988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:17.947663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d8ba7-efaf-428a-a678-cd9bd5d6e3a9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:17.949868 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:17.988952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:17.989702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:17.990126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:17.990471 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:17.999310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.001231 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:18.018030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:18.019597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 356/698] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:18.021933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.075241 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 343/699] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jun 17 07:14:18.076230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.142278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:18.149624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54a8b8a-096b-43f0-906e-c5649cc76cd4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.195526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.196723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.197233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.197586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.200693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de94304-b064-4be2-871a-1c2bdc933977 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.210588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.213312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.217102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:18.233981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:18.235538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:18.236516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:18.236516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:18.236516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:18.236516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:18.236516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 357/700] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:18.237204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.243399 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.244228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.244667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.245059 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.245950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:18.246364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.247971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.262098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 344/701] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:18.263015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.369805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3525536a-3fe9-447a-b7da-8f2ee678909b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.372031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f1194b-eb09-4968-9a3f-fe04d1a8a563 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.406244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.407087 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.407468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.407869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.408686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:18.409094 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.410565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.415056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.416016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.416302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.416584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.431622 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 345/702] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:18.432583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.439192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.440787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.448343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:18.461240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:18.462229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:18.463150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:18.463150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:18.463150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:18.463150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:18.467008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 358/703] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:18.468009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.479918 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:18.577301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea65690-348e-44e2-ac6c-a5be575a3320 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.588822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c09df4-1a20-4741-923b-9d447486330e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.618727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.619506 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.619822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.620109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.620939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=85359b608acd4054af1ef3ea85f3e271) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:18.621257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.622697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.627786 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478f3fe0-96f4-4734-ab96-c6fb9092305c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.628639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3fe0-96f4-4734-ab96-c6fb9092305c None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.628759 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 346/704] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/role_assignments?user.id=85359b608acd4054af1ef3ea85f3e271&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:18.629151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3fe0-96f4-4734-ab96-c6fb9092305c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.629521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.629712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f3fe0-96f4-4734-ab96-c6fb9092305c None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.630545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f3fe0-96f4-4734-ab96-c6fb9092305c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.632158 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478f3fe0-96f4-4734-ab96-c6fb9092305c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.659795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 359/705] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:14:18 2022] POST /identity/v3/users => generated 254 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:18.659795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdff40-9388-4cd6-a6de-bffe31648029 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.659795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdff40-9388-4cd6-a6de-bffe31648029 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.659795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5bdff40-9388-4cd6-a6de-bffe31648029 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.659795 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 360/706] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:18.664806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.665216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.667490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.709225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:18.711894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:18.848243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:18.866647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:18.877737 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a47679-84ce-4ed0-9554-2887ce80f0b7 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:18.890940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 361/707] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:18.920470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:18.940441 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:18.941140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:18.941428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:18.941722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:18.942446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:18.943048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:18.944627 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:18.958108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 347/708] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:18.964387 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.050047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df0a92d-4eab-4a66-9b74-f933dd1d32d6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.100485 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c483a9-a2af-4aa6-98ea-92364b48c1ee None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.105387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.106985 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.107632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.108173 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.109318 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.111656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-44c42bb2-6dc2-4fc6-82de-b501f1cc9a68 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:19.137159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:19.138192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:19.139016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:19.142952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 362/709] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:19.144560 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45659856-abca-4172-b59e-ac785fdf5600 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.145048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45659856-abca-4172-b59e-ac785fdf5600 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.145521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45659856-abca-4172-b59e-ac785fdf5600 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.147496 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 363/710] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:19.149419 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45659856-abca-4172-b59e-ac785fdf5600 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.153842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.157853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.157853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.157853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.172689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.175029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1bb979a3-16f7-41b0-9bdd-2ca0f8490171 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:19.196414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:19.197395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:19.198268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 348/711] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:19.205029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.205029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.205029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.228208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:19.229572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:19.231504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:19.246727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:19.289882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45659856-abca-4172-b59e-ac785fdf5600 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.329463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 349/712] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:19.331570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.341875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.341875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.341875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.341875 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.342342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:19.342342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.342342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.357943 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 364/713] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:19.359168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.474717 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bee9840-1fba-4fed-b69f-e661dec39cac None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.507036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d7ce05-0155-4587-8393-9d61b7068414 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.525735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:19.526783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.528097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.528789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.529463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.530260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:19.530573 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.533962 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.552000 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 350/714] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:19.552946 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.559544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.559914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:19.561668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.562023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.562383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] PATH_INFO: `/v3/services/network` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.563243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.564800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:19.581911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:19.583201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:19.584194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 365/715] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/services/network => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:19.585100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.693078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef769-1c1a-48c6-ba3a-717f44ee2587 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.719523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172d667e-6b6f-4958-83e1-a7ffcef38040 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.731438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.732427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.732869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.733286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.734129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:19.735116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.736662 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.748201 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 351/716] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:19.749391 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:19.771934 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.772652 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.773086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.773603 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.774703 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=4f968a9c3d3d4dbfb71216af67cd291e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:19.775049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.776596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.790938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 366/717] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/role_assignments?user.id=4f968a9c3d3d4dbfb71216af67cd291e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:19.856197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:19.901539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ff9ac3-fc5d-4c71-b186-9f9eba80a9b4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:19.970815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:19.971448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:19.971738 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:19.972048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:19.972806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] RBAC: Adding query filter params (name=network) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:19.973121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:19.974654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04feb144-f83c-441f-be84-78ffabc34567 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:19.980302 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 352/718] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:19.986601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:20.072302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:20.147386 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a8dbb4-bb22-4494-9304-d1ffbdc146af None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:20.186078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:20.186766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:20.187054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:20.187951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:20.188722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] RBAC: Adding query filter params (type=network) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:20.189036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:20.190413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a2c77-b213-476b-be7c-2c6aafec0507 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:20.197396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 367/719] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:21.302292 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c4c7-9a49-4077-b9a0-5e32a718c547 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.302842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c4c7-9a49-4077-b9a0-5e32a718c547 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.302842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae41c4c7-9a49-4077-b9a0-5e32a718c547 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.304550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 353/720] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:21.309654 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.310101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.310305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.329120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:21.329890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943e33-2b9d-434f-a87a-cd0b788db310 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.330180 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943e33-2b9d-434f-a87a-cd0b788db310 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.330287 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:21.330465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04943e33-2b9d-434f-a87a-cd0b788db310 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.332111 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 354/721] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:21.338561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.338843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.339117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.370221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:21.371815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:21.487856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 368/722] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:21.488988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 355/723] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jun 17 07:14:21.512031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:21.522396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:21.589468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:21.599227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:21.630050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3b3816-4da7-4acb-ac6c-9a9d827b4756 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:21.669348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:21.670164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.670450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.670726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.682500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:21.691150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:21.692164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:21.692982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 356/724] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:21.705416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:21.741717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc9028-1e64-423c-83f2-7f25bfc9fbb5 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:21.805352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:21.806491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.806951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.807415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.832743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:21.835936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4665937b-7e6b-45a9-b8bc-8392d1bbc14a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:21.847787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:21.848787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:21.849723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 369/725] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:21.852514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:21.876268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:21.897420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:21.898268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:21.898567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:21.898972 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:21.902133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:21.902453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:21.904210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:21.921071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 357/726] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:21.927529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.009337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:22.024262 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449da7cc-6e25-4f4f-9652-44b796d228b8 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.079557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829aef43-c7db-45f8-b3db-148c48d53a2f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.118532 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.119744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.120231 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.120682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.133682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.134706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.135164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.135608 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.137337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:22.137831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.140265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.149363 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.150962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 370/727] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:22.156319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.168233 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:22.218261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:22.219273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:22.220255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:22.220255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:22.220255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:22.220255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:22.220255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 358/728] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:22.225317 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.295886 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:22.324190 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd0535f-03f0-4567-95c0-245284745bae None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.408775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de715f9-4efd-48e2-a8e7-021494e26d9d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.410285 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.411644 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.412159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.412623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.460107 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.461579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.472267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.472971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.473257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.473538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.474281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:22.474595 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.476377 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:22.496002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:22.497017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:22.497957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:22.497957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:22.497957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:22.497957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:22.497957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 371/729] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:22.504469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.505978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 359/730] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:22.512571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.523269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:22.626491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc991f7-ce6b-4db6-8c17-7c23e4f62a68 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.645875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:22.653074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c7f9fa-9c67-4b0b-a3bd-894bc0c30640 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.667013 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.667693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.668004 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.668281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.669108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:22.669418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.670892 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7aa61b-24f7-45a9-b21b-af95b6840463 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.684837 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 372/731] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:22.686194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e41c-603a-4a79-a74e-f8404589bd37 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.686485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e41c-603a-4a79-a74e-f8404589bd37 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.686864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813e41c-603a-4a79-a74e-f8404589bd37 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.692332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 373/732] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:22.693189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e41c-603a-4a79-a74e-f8404589bd37 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.693301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.694137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.694429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.694712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.703559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.705255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1a375784-c517-4409-bb5a-886d13b856e6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:22.722887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:22.723917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:22.724875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 360/733] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:22.725971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.726068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.726275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.751009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:22.752694 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:22.784858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:22.827073 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813e41c-603a-4a79-a74e-f8404589bd37 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:22.853150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 361/734] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:22.854452 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.873500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:22.874322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.874611 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.874975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.883835 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:22.885242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3481b4ad-78a8-4b4e-b17d-73856cc5bdf0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:22.901243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:22.902344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:22.903561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 374/735] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:22.904697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160961-cffd-4c0f-ad6e-348e734ebc7e None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:22.904697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160961-cffd-4c0f-ad6e-348e734ebc7e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:22.904852 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e160961-cffd-4c0f-ad6e-348e734ebc7e None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:22.906858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 375/736] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:22.907525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160961-cffd-4c0f-ad6e-348e734ebc7e None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:22.970566 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:22.988789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe15740-d9ca-46b7-bfed-9b043f652b06 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.024870 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.025546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.025832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.026111 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.026724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e160961-cffd-4c0f-ad6e-348e734ebc7e None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.026951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:23.027267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.029000 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2681e6-e74e-48d3-8183-b9af54f6ea98 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.046674 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 362/737] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:23.048004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cdedf-21e9-4be3-af72-7cc1c99bb565 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.048290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cdedf-21e9-4be3-af72-7cc1c99bb565 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.048566 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cdedf-21e9-4be3-af72-7cc1c99bb565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.057163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.065959 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.066567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c61cdedf-21e9-4be3-af72-7cc1c99bb565 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:23.066759 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.067044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.067339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.067855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c61cdedf-21e9-4be3-af72-7cc1c99bb565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:23.084766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:23.092774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:23.094339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:23.095163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 376/738] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:23.095881 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.141872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 363/739] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:23.143380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878f85-6d28-411d-8478-c97a1e07fa0d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.143676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878f85-6d28-411d-8478-c97a1e07fa0d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.143991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba878f85-6d28-411d-8478-c97a1e07fa0d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.145435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 364/740] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:23.146048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878f85-6d28-411d-8478-c97a1e07fa0d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.201818 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c72bf61-1d89-4c64-af65-c96a391111f2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.236414 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.237101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.237265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.237387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.237671 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.238522 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:23.238836 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.240302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.258932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 377/741] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 17 07:14:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:23.260396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.274517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba878f85-6d28-411d-8478-c97a1e07fa0d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.307853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.316587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.317251 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.317539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.317824 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.361748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150f7ccf-c754-40ad-b2d9-9427363b18cf None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.387338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.388858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.396161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.396767 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.397052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.397331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.398108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:23.398410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.399792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ebd8c8-b44a-46cc-a271-b62ed37c8bec None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.408624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 378/742] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:23.409920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.410213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.410494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.428086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:23.429352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:23.471531 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.500830 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 365/743] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:23.501306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.501620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 379/744] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jun 17 07:14:23.502517 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.549329 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.610254 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d00a91-5376-4278-b22f-3bc94718c0ab None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.617066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d940db5b-8452-4c99-bd8e-9a77422f8444 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.651319 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.651944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.652231 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.652513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.653497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.654877 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.657838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.658496 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.658788 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.659184 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.676096 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 366/745] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:23 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:23.677214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.733082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.772111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.773723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.836495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14263def-5676-4b15-9cef-8c98f63c5841 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:23.838147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:23.890451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:23.891366 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:23.891660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:23.891972 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:23.906463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:23.907897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:23.921294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 380/746] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jun 17 07:14:23.921294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:23.935560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:23.936652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:23.937543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:23.937543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:23.937543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:23.937543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:23.937543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 367/747] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:23.938291 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.059436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:24.083032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66400718-3e94-43aa-baff-aaf60b7d0da3 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.089703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc934077-6980-401f-9689-c7b04c21bf67 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.128684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.129487 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.129769 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.130048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.137650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:24.144734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.147079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.147228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.147782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.148078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.148349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.149087 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.152275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.175950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 368/748] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:23 2022] POST /identity/v3/services => generated 240 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:24.175950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:24.176213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:24.177123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:24.178168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:24.178168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:24.178168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:24.178168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:24.178168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 381/749] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:24.178472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.346855 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7dab2-8e88-4682-a631-05d76cd26518 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.375434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75603b-8fee-49a5-ae7f-677b9f25ef6c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.405770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.407153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.407488 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.407613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.408702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:24.409021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.410422 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.436102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 382/750] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:24.436900 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.440434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.441250 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.441569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.441822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.451425 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:24.457821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.460100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:24.491897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:24.494838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:24.497843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:24.497843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:24.497843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:24.497843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:24.497843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 369/751] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:24.497843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.534642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:24.628518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d84a09f-35c6-4b8c-80c5-e25afbfb9eeb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.654974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726012b9-c18c-4a09-9f6d-5157691b064a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.682755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.684464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.684942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.685413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.686751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:24.687952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.691179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.704595 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.705625 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.706341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.706341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.711155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 383/752] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:24.712508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.723133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.724830 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:24.743527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:24.745197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:24.746469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:24.748464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 370/753] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:24.750092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:24.814606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:24.881941 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2f563d-03ca-4a0d-b2ba-8e1bd1b13a6b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:24.934296 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:24.936350 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:24.936976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:24.937475 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:24.947503 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:24.949412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:24.968654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:24.970533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:24.971943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:24.974599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 371/754] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:24.975908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.031459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444692c3-0ef1-4477-bf65-254520f42d0c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.044362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:25.073416 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.074431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.074975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.075364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.076272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:25.076695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.079920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.100562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 384/755] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:25.100562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.120895 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2cc181c-2343-427f-a268-bfa1a7b1d3aa None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.133397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:25.181618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.182954 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.183397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.184102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.185558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:25.186279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.188574 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.219328 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 372/756] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:14:24 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:25.220776 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.258047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e9cc0a-a66b-4edc-ab38-fafa9cc51161 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.298113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.299113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.299901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.300433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.301533 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:25.303809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.303809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.323803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 385/757] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:25.323803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.355813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:25.407897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071b893-cac3-4d8a-80cc-68158f3ab03f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.448862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.450004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.450464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.450915 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.451031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcf7884-eae5-45a4-9caa-5d2d91ec2497 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.460867 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.462669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:25.490591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:25.491618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:25.492974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:25.499011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 373/758] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:25.500215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.500585 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.501473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.501937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.502386 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.516037 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.518343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:25.542445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:25.543408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:25.544830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:25.544830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:25.544830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:25.544830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:25.545541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 386/759] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:25.550979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.553970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:25.640479 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45031988-a0b0-4b1c-91ad-906549818851 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.658670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:25.680745 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb42d9b7-0ad5-4125-a21b-e834190b3ec7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.681581 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.687084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.687084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.687084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.687084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=856489000f7b42f7b7920d13b03a8d6e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:25.687084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.687084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.699885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 374/760] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/role_assignments?user.id=856489000f7b42f7b7920d13b03a8d6e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:25.699885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.755109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.756310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.756834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.757367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.758433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:25.758955 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.763879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.788062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 387/761] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:25.793705 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:25.809089 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:25.820206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3fc3cd-22bc-4af6-ba19-a843703e6c0c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:25.913893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:25.914596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:25.914887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:25.915172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:25.915953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:25.916270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:25.917677 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:25.944398 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 375/762] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:25.951295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:26.034765 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc6a620-6ad9-4c71-b88e-ea9adf483f6c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:26.109023 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925a792a-405d-49a9-ac92-913f6bae81c2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:26.122995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:26.123889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.124175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.124970 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.125900 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=85359b608acd4054af1ef3ea85f3e271) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:26.126221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:26.127800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:26.143630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 388/763] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/role_assignments?user.id=85359b608acd4054af1ef3ea85f3e271&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:26.167349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:26.168632 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.169129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.169620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.178408 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:26.180493 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1c4670e4-2257-4c4e-897e-d9ff3417a2a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:26.197126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:26.198078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:26.198992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:26.201726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 376/764] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:26.213049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:26.230685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71d77-9c70-4c08-ab44-100ca3f8ab19 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.231011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71d77-9c70-4c08-ab44-100ca3f8ab19 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.231268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d71d77-9c70-4c08-ab44-100ca3f8ab19 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.233022 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 377/765] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:26.235478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:26.238641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.238935 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.239221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.269336 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:26.271261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:26.286051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:26.440342 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 378/766] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:26.455042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2879f26-8abc-43d2-9465-a5ea40342b46 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:26.466498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:26.508464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:26.509141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.509427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.509704 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.510503 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:26.510819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:26.512277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:26.541071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 389/767] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:26.545135 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:26.680858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:26.692239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6630af-35a6-45ad-98f3-14a555fef591 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:26.747356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd471bb0-f7c1-416d-99fd-4deb4d1bc070 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:26.751581 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:26.752815 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.753332 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.753816 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.755100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:26.756913 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:26.777547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:26.778865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:26.779789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 379/768] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Jun 17 07:14:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:26.791441 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:26.800562 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f308463f-deef-406f-b08d-6e5ade530030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:26.801477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308463f-deef-406f-b08d-6e5ade530030 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.801763 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308463f-deef-406f-b08d-6e5ade530030 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.802043 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f308463f-deef-406f-b08d-6e5ade530030 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/4f968a9c3d3d4dbfb71216af67cd291e/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.805576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:26.813255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308463f-deef-406f-b08d-6e5ade530030 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=4f968a9c3d3d4dbfb71216af67cd291e, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:26.814729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f308463f-deef-406f-b08d-6e5ade530030 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:26.834309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 390/769] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:26 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/4f968a9c3d3d4dbfb71216af67cd291e/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:26.836792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c887fe3-ac1d-4c69-9835-2797992920ea None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.837334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c887fe3-ac1d-4c69-9835-2797992920ea None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.837816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c887fe3-ac1d-4c69-9835-2797992920ea None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.839751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 391/770] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:26.845186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:26.846041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:26.846523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:26.869130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:26.871564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:26.972162 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 392/771] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:26 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:27.012368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ce43ee-d2f5-462c-b6e3-0920c2a96018 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.018565 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.074564 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.075668 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.076148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.076482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.077305 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:27.077562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.079496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.084971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 380/772] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 17 07:14:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:27.090647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.103248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:27.157540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce9c45-3a2a-40f9-ae0a-ded2be7d6e59 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.194113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.195156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.195455 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.195792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] PATH_INFO: `/v3/services/network` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.196687 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.198228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.219588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:27.230160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:27.231220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:27.232106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 393/773] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:27.240819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.257004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5e8037-6136-4b4a-afc3-382845b03105 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.297218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.298212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.298524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.298837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.299638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:27.299978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.301379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.308128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 381/774] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:27.314545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.458694 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459dfff-3e24-42af-9062-93c74af4d4d1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.483321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:27.525392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.526125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.526415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.526693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.527438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] RBAC: Adding query filter params (name=network) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:27.527749 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.529443 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.542874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 394/775] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:27.553213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.582199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2d74ec-c743-46f2-8266-c06e7767dbce None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.657606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.658289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.659725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.660044 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.660855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] RBAC: Adding query filter params (interface=public, service_id=d49ff672b44446438e8a8a5858b10599, region_id=RegionOne) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:27.661176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.662587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.668086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:27.683143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 382/776] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/endpoints?service_id=d49ff672b44446438e8a8a5858b10599&interface=public®ion_id=RegionOne => generated 194 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:27.688720 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.701693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45b7d6-c501-4bc0-890a-a139f0b610de None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.763148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.763863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.764206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.764491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.765253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] RBAC: Adding query filter params (type=network) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:27.765568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.767069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.780507 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 395/777] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:27.789485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:27.880228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff23e1-eb13-4683-b8e4-71358d647bb9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:27.902329 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:27.916531 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:27.917263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:27.917553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:27.917888 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:27.918594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:27.920181 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:27.926547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 383/778] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/services => generated 772 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:27.975385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71335c-2243-4c59-b11b-fb62b11b363f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:28.034871 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:28.035624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:28.035942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:28.036214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:28.037081 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] RBAC: Adding query filter params (interface=public, service_id=f9c6ba48e493402193aad3ca604e01e3, region_id=RegionOne) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:28.037404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:28.039220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af10b64a-7e02-4d1c-8720-b796ee544c08 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:28.052815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 396/779] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:14:27 2022] GET /identity/v3/endpoints?service_id=f9c6ba48e493402193aad3ca604e01e3&interface=public®ion_id=RegionOne => generated 194 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:28.058177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:28.146411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:28.210265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3b7d32-b6fe-4a6a-9b3a-6422296232fa None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:28.248891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4300d8f-c657-4ae1-b283-95945757fd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:28.249976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300d8f-c657-4ae1-b283-95945757fd17 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:28.250494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300d8f-c657-4ae1-b283-95945757fd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:28.250980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4300d8f-c657-4ae1-b283-95945757fd17 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:28.251931 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4300d8f-c657-4ae1-b283-95945757fd17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:28.253533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4300d8f-c657-4ae1-b283-95945757fd17 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:28.263935 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 384/780] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:28 2022] GET /identity/v3/services => generated 772 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:28.398459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad6df7-ca61-4132-993e-3d3af477d1bd None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:28.398811 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad6df7-ca61-4132-993e-3d3af477d1bd None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:28.398988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad6df7-ca61-4132-993e-3d3af477d1bd None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:28.400774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 397/781] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:28.407148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:28.407826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:28.408336 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:28.436349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:28.438498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:28.531594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 385/782] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:28.558432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad6df7-ca61-4132-993e-3d3af477d1bd None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:28.721702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad6df7-ca61-4132-993e-3d3af477d1bd None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:28.740863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:28.771593 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:28.772450 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:28.772741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:28.773083 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:28.789299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:28.798697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:28.800490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:28.801872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 398/783] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:28.813043 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:28.919519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:29.002641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc95db3-4b03-4785-8aad-ddbb74aed419 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.059615 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:29.060763 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.061281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.062426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.063460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:29.064032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:29.065704 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3841e437-92d1-4f3b-b223-03374c9cf006 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:29.082522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 386/784] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:29.088607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:29.201538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edac02f-fb21-457e-9899-c443b540d48c None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.202177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edac02f-fb21-457e-9899-c443b540d48c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.203252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edac02f-fb21-457e-9899-c443b540d48c None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.208997 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 387/785] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:29.217641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.219186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.219840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.259625 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:29.261322 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:29.267734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c025e-5c74-48bd-b86d-1c7d8235cba5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.312529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:29.313720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.314274 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.314563 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.327618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:29.330635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:29.356585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:29.357561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:29.358725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:29.358725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:29.358725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:29.358725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:29.358725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 399/786] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:29.365394 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:29.392991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 388/787] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:29.396070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:29.441523 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:29.505545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd39544-8bcb-4a13-ab3d-5edbdee26a15 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.541566 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:29.542159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:29.543871 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.544424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.544920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.545866 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:29.546874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:29.548498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:29.563145 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 400/788] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:29.569351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:29.630110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53190601-edb9-488d-b1b8-97eacae12eb7 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.668605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:29.669889 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:29.671669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.672610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.672992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.685954 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:29.690641 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51a14cb-8ef5-4d50-98ea-1374a147ce2a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:29.694953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:29.695922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:29.696783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 389/789] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:29.709105 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:29.734978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:29.736453 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:29.736973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:29.737469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:29.745873 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:29.747605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:29.784080 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:29.785194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:29.786146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 401/790] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:14:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:29.797381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:29.961559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5ce129-2a11-417d-a435-ae136187831f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.974340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f9fa16-8d8f-465a-8354-1eb3d439bce7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:29.986460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:30.011299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.011822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.012125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.012496 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.013272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:30.013591 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.015079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477e685c-1e79-4e05-a5dd-b8594f43d9dd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:30.042613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 402/791] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 17 07:14:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:30.042613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf6c1-15b1-46bf-a065-81955620453c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.042613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf6c1-15b1-46bf-a065-81955620453c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.042613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf6c1-15b1-46bf-a065-81955620453c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.043339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 403/792] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:30.043864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf6c1-15b1-46bf-a065-81955620453c None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.047266 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:30.051587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.053189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.054038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.054779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.056855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:30.057789 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.061539 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b82a701-6b2b-4c66-aaca-72ca22b1b224 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:30.079973 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 390/793] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:30.082887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.083754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.084723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.118713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:30.121209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:30.168800 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf6c1-15b1-46bf-a065-81955620453c None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.207315 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.208208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.208498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.208776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.220220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.221733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:30.241954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:30.244207 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:30.246312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:30.246312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:30.246312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:30.246312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:30.247878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 404/794] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:30.248707 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.283031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 391/795] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:30.284038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.380598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:30.401538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722bca44-0fb4-41d0-a6a1-9d87f7d0e02f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.449358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:30.450098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.451211 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.451689 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.451988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.452938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7becf-1653-4a39-b66c-594d40c47979 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.467412 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.469492 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:30.492578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:30.494021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:30.495523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:30.495523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:30.495523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:30.495523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:30.499034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 405/796] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:30.500765 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.513488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.514662 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.515240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.515747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.516722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:30.517239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.518884 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:30.536833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 392/797] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:30.538402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.667200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ca805-b4ee-4ced-94e8-03e5ef705b56 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.683826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:30.730110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a1d0d0-6db0-4438-af22-dba6c3e6d4f1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.733011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.735481 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.736182 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.736715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.756225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:30.768678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:30.769706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:30.770663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:30.771412 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 406/798] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:30.772222 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.795152 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.797109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.797504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.797794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.798484 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:30.798812 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.800272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543b082-100f-4fa4-bc44-cf0001a34376 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:30.818613 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 393/799] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:30.820537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d86aa-4d12-474f-98a7-f32e851a08b1 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.820957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d86aa-4d12-474f-98a7-f32e851a08b1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.821231 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0d86aa-4d12-474f-98a7-f32e851a08b1 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.827662 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 394/800] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:30 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:30.828788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d86aa-4d12-474f-98a7-f32e851a08b1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:30.864360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:30.917933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873f2be3-6835-445a-803b-4712462f77a5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.964013 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:30.965221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:30.965685 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:30.966118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:30.976153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0d86aa-4d12-474f-98a7-f32e851a08b1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:30.983381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:30.986046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:31.010651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:31.011642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:31.012637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 407/801] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:31.013761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.028488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.029201 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.029508 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.029788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.031587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:31.031931 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.033310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3eaa1-70d4-4f8c-9734-a20f5d318e1f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.048078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 395/802] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:31.049149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.049149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.049149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.063103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.069867 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:31.071856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:31.149432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 396/803] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:31.150059 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.168520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.180284 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fdbfff-d9ea-45f4-b486-fb9145b0427a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.219154 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.219997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.220283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.220556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] PATH_INFO: `/v3/users/swift` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.228549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.229989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:31.244831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:31.246016 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 408/804] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:31.247007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.271588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb86bca2-a466-42bb-a55b-df670b029d07 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.307259 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.307964 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.308256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.308533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.309346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:31.309822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.311283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecded8-a754-4ba9-8571-0e5b8f0d65a7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.326171 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 397/805] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:31.328086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1105e-a3e0-479c-ab12-ff35939ffbcd None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.328385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1105e-a3e0-479c-ab12-ff35939ffbcd None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.328675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1105e-a3e0-479c-ab12-ff35939ffbcd None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.329932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 398/806] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:31.330624 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1105e-a3e0-479c-ab12-ff35939ffbcd None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.354223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.370646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c56135a-9819-4f31-b063-5192223ff5dc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.406458 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.407275 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.407553 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.407865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.412699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.419045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.420655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:31.438547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:31.439542 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:31.440556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:31.440556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:31.440556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:31.440556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:31.440556 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 409/807] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:31.440873 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.446487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1105e-a3e0-479c-ab12-ff35939ffbcd None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.493281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.494097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.494398 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.494702 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.495374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.496799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:31.510155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:31.511942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:31.513490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 399/808] 10.222.0.58 () {56 vars in 1129 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:31.515792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.558209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910d44c7-e7b8-470f-9a1c-f80e90c37736 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.600660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.601347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.601636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.601919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.602776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:31.603089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.604576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501d61c8-7e12-451b-b33d-a92ef3cb6a75 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.613076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.623907 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59a0f21-daae-4c5c-9665-1e8ab433e193 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.624157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 410/809] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:31.626142 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.626436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.626838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.644065 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:31.645268 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:31.659154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.660076 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.660353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.660626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/856489000f7b42f7b7920d13b03a8d6e/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.663989 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.676125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=856489000f7b42f7b7920d13b03a8d6e, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.677533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.700235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 400/810] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:31 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/856489000f7b42f7b7920d13b03a8d6e/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:31.700235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.735846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 411/811] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:31.735846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.814492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f1d2b-74a3-4dd9-b4ba-b8e21e6b1db1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.851698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.852833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.852833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.852970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.853665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:31.853981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.855394 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.862639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f34081f-3f3c-433c-a864-72676191e0ca None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:31.869766 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 401/812] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:31.870665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.892338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.902084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:31.902782 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:31.903332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:31.903613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:31.904341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:31.904646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:31.908181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:31.916296 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 412/813] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:31.916296 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:31.924631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:31.989607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a358fd-427e-4015-91a1-446c63dd0a96 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.030547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.030888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510a3bae-4d43-493c-9013-53fa6b9fb73a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.031397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.031691 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.031999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.045335 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.047465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:32.066160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:32.067217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:32.068686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:32.068686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:32.068686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:32.068686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:32.071912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 402/814] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:32.072979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.074392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.075205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.075490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.076021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] PATH_INFO: `/v3/services/network` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.077739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.079121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:32.091510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:32.092561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:32.094077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 413/815] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:31 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:32.094864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.163029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:32.181900 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:32.186593 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92c7e8-b3a1-446f-9c0a-4c0ee7f63369 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.213129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29cf4fa-2e00-4e16-92ea-ff3be1f06900 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.224659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.225648 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.226178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.226597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.235608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.237278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.247164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.247791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.248090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.248368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.249072 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:32.249417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.250773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:32.252807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:32.253744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:14:32.254689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:32.258559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 403/816] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:32.258817 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 414/817] 10.222.0.58 () {56 vars in 1124 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:32.259404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.259928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.365473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fa2122-9a1c-4516-b688-e417747af51e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.366917 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9dc0e2-1868-42e9-8f4b-1ccb0709cdfa None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.384039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:32.400507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.401187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.401479 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.401759 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.402481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:32.402796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.402893 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.403794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.404089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.404367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.404460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.405068 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] RBAC: Adding query filter params (name=network) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:32.405891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.407787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.412776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 415/818] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:32.413488 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.423500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 404/819] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:32.428738 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.447681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:32.527472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d6bf-b95c-4351-b2f5-4428c414f55d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.552451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb74a2b9-3940-412e-9592-412e8a719b4b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.563382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.564162 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.564517 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.564880 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.565787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:32.566170 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.567696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.591330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 416/820] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:32.592377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.594852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.595688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.596138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.596580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.597499 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.599082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.626192 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 405/821] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:32 2022] POST /identity/v3/endpoints => generated 346 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:32.627414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.698474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:32.747403 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:32.809933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aacd0c-c402-4688-b0fb-79eda2a9bd09 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.859990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.860822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.861104 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.861379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.873707 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.875306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:32.902774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:32.905193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 406/822] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:32.908164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:32.909518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbc8d3c-18d2-40b1-a37d-4ee3e389815d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:32.972854 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:32.973547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:32.973831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:32.974107 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:32.974825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] RBAC: Adding query filter params (type=network) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:32.975136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:32.976537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:32.982548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 417/823] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:32.983490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:33.078402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa639d1e-3758-4a2b-a38f-dbf30e279f9a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:33.110310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:33.118743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:33.119524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.119948 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.120427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.124043 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1008f9c4-2bf2-4192-9856-7c9ed68217dd None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:33.126570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:33.176469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:33.178300 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.178815 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.179306 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.180355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:33.180887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:33.182944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:33.198390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 418/824] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:33.199461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:33.222273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:33.223926 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:33.331564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe699ea-f0ac-4a6c-9d46-4e4f43cebaf6 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:33.344204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 407/825] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:32 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:14:33.345156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:33.376181 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:33.378189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:33.379076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.379807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.380211 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.381240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:33.382613 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:33.415858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 419/826] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:33 2022] POST /identity/v3/endpoints => generated 327 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:33.417247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:33.463131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:33.516722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b6bac7-68a2-49a6-9235-b2964e4afef2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:33.606880 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:33.610619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.611869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.612562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/85359b608acd4054af1ef3ea85f3e271/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.616879 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=85359b608acd4054af1ef3ea85f3e271, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:33.619340 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:33.628230 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c58538-933e-4cbc-ae77-19ca750532d7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:33.641361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 408/827] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:33 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/85359b608acd4054af1ef3ea85f3e271/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:33.687335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:33.688694 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.689248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.689736 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.703813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:33.705751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:33.726171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:33.727250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:33.728187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:33.728187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:33.728187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:33.728187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:33.730301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 420/828] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:33.737825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:33.839185 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:33.861228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80424042-0f67-42b2-b18d-4e9b69a920eb None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:33.900176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:33.900865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.901153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.901432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.902175 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:33.902488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:33.904239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cae1c-0366-4567-895d-fb49752f3aad None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:33.918986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 409/829] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:33.925336 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:33.989571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7caae3-d527-4c29-93db-d6dd0912a1db None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.989861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7caae3-d527-4c29-93db-d6dd0912a1db None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.990146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7caae3-d527-4c29-93db-d6dd0912a1db None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:33.991524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 410/830] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:33.997507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:33.997796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:33.998082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.021975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:34.023274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:34.024572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:34.054687 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ec9725-fc76-4db6-a8fd-b6323c0b8730 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:34.090889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:34.091698 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:34.092018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:34.092301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.101327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:34.102776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:34.127860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:34.128848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 421/832] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:34.129724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:34.130875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 411/832] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:34.151556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:34.256007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814ab131-7223-46ac-8a15-311488cb08cd None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:34.291494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:34.298954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:34.299988 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:34.300445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:34.300882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.302046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:34.302531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:34.304188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:34.318388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 422/833] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:34.324642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:34.373384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:34.403623 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d4eb5f-c685-4593-b371-c3a0a33d5709 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:34.446285 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d183fe-3ec9-4e9b-bac3-a3a4313d8c35 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:34.450988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:34.451927 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:34.452894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:34.453241 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.467353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:34.478262 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:34.479263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:34.480169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 412/834] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:14:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:34.489495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:34.489675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:34.489675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:34.489675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:34.489675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.489966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=4f968a9c3d3d4dbfb71216af67cd291e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:34.489966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:34.491806 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:34.498383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 423/835] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:34 2022] GET /identity/v3/role_assignments?user.id=4f968a9c3d3d4dbfb71216af67cd291e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:34.610341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde54508-a891-46bb-9f0c-7df986de4874 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:34.655423 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:34.656067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:34.656351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:34.656625 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.657388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:34.657697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:34.659121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:34.665107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:34.672213 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 413/836] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:34.675417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:34.737339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:34.787324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae6d440-8ddc-4af7-96e7-925bb266c903 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:34.822411 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:34.823222 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:34.823508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:34.823799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:34.834580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:34.836042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:34.853128 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:34.854052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:34.854948 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:34.854948 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:34.854948 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:34.854948 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:34.854948 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 424/837] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:34.860725 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:34.968273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92292e-a3b6-41cc-972b-cec8af05b54c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.005491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.006194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.006477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.006749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.007490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:35.007819 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.009275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd35890f-517e-4c85-bd5f-995d8fbe92ad None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.032069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 414/838] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:35.036378 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.071788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d8d3-8bbc-4ced-a112-ef52f88f7035 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.072108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d8d3-8bbc-4ced-a112-ef52f88f7035 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.072389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f1d8d3-8bbc-4ced-a112-ef52f88f7035 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.074932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 415/839] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:35.079007 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.079353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.079591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.098603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:35.099825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:35.168503 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:35.179558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b285e6ef-71c4-4364-b4d6-c37b4c3ab936 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.189820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:35.194230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 416/840] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:35.216103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.226117 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.227143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.228034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.228478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.241496 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.243662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:35.263425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:35.264614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:35.265754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:35.268725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 425/841] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:35.274419 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.347265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ea443f-a6b4-472d-ac4f-d51636ac9194 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.387852 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b6535d-3a36-473d-9cef-ff05104b6c21 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.393589 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.394529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.394914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.395288 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.396133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.398103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:35.415003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:35.416314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:35.417351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:35.423946 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 417/842] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:35.426519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.430663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.431715 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.432160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.432587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.433570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:35.434023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.435614 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.459624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 426/843] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:35.460844 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.489271 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:35.491613 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:35.543603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a98bc3f-475e-4b55-a7be-8a97b729ec6d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.566646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907b3cf9-1a38-4489-a74e-c804b274e91a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.579500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.580432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.580794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.581169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.582146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:35.582577 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.584121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.594350 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 418/844] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:35.595711 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.605514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce16e940-0a82-48b3-a4a1-fed56a647d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.606416 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16e940-0a82-48b3-a4a1-fed56a647d60 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.606843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16e940-0a82-48b3-a4a1-fed56a647d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.607267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce16e940-0a82-48b3-a4a1-fed56a647d60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.677028 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16e940-0a82-48b3-a4a1-fed56a647d60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.678720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce16e940-0a82-48b3-a4a1-fed56a647d60 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.701173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec359f6-86ff-45f9-be3b-ea5932ac3bf3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.706474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:35.719734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:35.740225 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.740964 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.741349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.741726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.742537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:35.742951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.744505 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.755844 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 419/845] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:35.798741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 427/846] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:14:35.804755 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:35.929763 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274f70c1-3264-4b79-a71b-ccebf1659d0f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:35.966996 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219d4e-f549-40fb-adf9-f952f93cfe74 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.967294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219d4e-f549-40fb-adf9-f952f93cfe74 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.967457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:35.967593 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05219d4e-f549-40fb-adf9-f952f93cfe74 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.968329 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.968621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.968903 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.969076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 428/847] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:35.974466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:35.974756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:35.975043 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:35.981205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:35.982740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:35.994253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:35.995381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:36.001216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:36.002107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:36.003010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:36.003010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:36.003010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:36.003010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:36.003010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 420/848] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:36.010268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.047049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.073648 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 429/849] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:36.097002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.139666 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf22e83-9984-490c-912a-05034891b520 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.158518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.184238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.185097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.185453 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.185832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.186715 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:36.187125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.188948 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.203347 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 421/850] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:36.208415 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.208564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b8199-123c-4f07-b13f-014fb4a8c52b None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.244589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.245658 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.246097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.246521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.257709 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:36.266186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:36.267339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:14:36.268437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:36.275289 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 430/851] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:36.276468 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.321109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.336960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b536fa3-9b34-4afb-b47f-8e89a921f8fa None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.374856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.376084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.376553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.377014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.384482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.386173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:36.401240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:36.402218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:36.403380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:36.404106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7527df9a-9072-4c50-83ad-c9ebd6321c61 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.406350 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 422/852] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:36.413220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.423982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.447185 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.447970 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.448313 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.448594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.449409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:36.449724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.451161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.465388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 431/853] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:36.466294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.537526 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9a68b2-1136-4c2d-af4d-be8621335952 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.573592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.574273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.574597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.574892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.575687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:36.576049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.577773 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.595951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 423/854] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:36.598134 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.601019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca95ca7d-1e99-4d04-86d9-8401f9199eb2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.615960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.646753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.647686 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.648113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.648464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.660595 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.662134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:36.680702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:36.681663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:36.682552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:36.682552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:36.682552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:36.682552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:36.687186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 432/855] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:36.687912 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.719791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.738670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47cc939-82df-475c-b42c-e04b28cc169d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.785973 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.787470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.788153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.788617 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.790402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=856489000f7b42f7b7920d13b03a8d6e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:36.791071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.793180 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.797395 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e98c186f-b535-4b04-8545-9a784034770b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:36.808591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 424/856] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/role_assignments?user.id=856489000f7b42f7b7920d13b03a8d6e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:36.841022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:36.841717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.842004 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.842283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.843572 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:36.843922 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:36.845337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc3c4b7-7a2b-47ed-b717-efce3fb92763 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:36.860957 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 433/857] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:36.866481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:36.877552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17355-75a6-4995-a97f-b575a9024a9c None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.877879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17355-75a6-4995-a97f-b575a9024a9c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.878120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f17355-75a6-4995-a97f-b575a9024a9c None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.879794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 434/858] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:36.885808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:36.886529 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:36.887157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:36.906413 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:36.908101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:36.988195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:36.988596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 435/859] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:36.995797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863b43a1-cf42-4174-ad3e-e2f8b1225052 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.012220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.038091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:37.051536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.052795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.053560 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.054275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.063402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.064915 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:37.080172 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:37.081146 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:37.082109 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 425/860] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:14:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:37.089063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.148741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a988e848-1565-4071-9cc3-24fed98aeb8d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.190319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.191523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.191845 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.192131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.192804 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.194501 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:37.210437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:37.211410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:37.212338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:37.215905 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 436/861] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:37.218344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.230084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e491d37-aa2d-4cae-b351-1c9a5876b984 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.275545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.276633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.277596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.278351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.279744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:37.281007 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.283272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.287189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:37.307557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 426/862] 10.222.0.58 () {56 vars in 1135 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:37.314494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.318480 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:37.337600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b9c7cb-61e1-4671-87a0-0d2ac7342149 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.372370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.373424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.374505 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.374981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.375976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:37.376502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.378060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.383431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 437/863] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:37.389092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.447494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf358123-cf75-480f-a5ef-adcc1f03281b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.498301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.499638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.499992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.500276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.501853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ddba5-3bd1-46d5-872d-ea7eb28cd4d6 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.538809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.539593 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.539996 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.540351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.541163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:37.541588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.543086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.556229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 438/864] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:37.575966 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:37.590804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.593703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.705628 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 427/865] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:14:37.711029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:37.732811 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:37.825729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbc675-20bc-4484-b055-a86be7bcd052 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:37.865324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:37.866499 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:37.866990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:37.867470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:37.878961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:37.880697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9186f4af-3cfe-48f4-9770-32da9545dbdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:37.899048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:37.899993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:37.900901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:37.900901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:37.900901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:37.900901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:37.903418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 439/866] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:37.909206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:38.012968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9c7a-6541-4453-bf1e-65599ad7a283 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.013689 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9c7a-6541-4453-bf1e-65599ad7a283 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.014196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4a9c7a-6541-4453-bf1e-65599ad7a283 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.021458 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 440/867] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:38.024010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.024594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:38.025150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.026403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.032481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20edb91a-54c4-458f-8e0e-729ade0a330b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:38.048269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:38.049821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:38.069490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:38.070264 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.070482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.070719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.071445 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:38.071779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:38.073160 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:38.086066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 428/868] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:38.093324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:38.131493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:38.149499 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 441/869] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:38.177044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:38.209243 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7b4675-edf3-49b7-94d4-3afe97e00f28 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:38.244335 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:38.245130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.245438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.245723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.253260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:38.254727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:38.269722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:38.270714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:38.272090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 429/870] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:38.276757 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:38.293030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd95cfc-953f-4fed-aa40-55c4e9bb68b6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:38.297864 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:38.333422 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:38.334576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.335075 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.335546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.336514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:38.338424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:38.368550 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 442/871] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:38 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:14:38.434916 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e4d8d-d6fb-48d6-9707-82e00658948c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:38.513223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:38.513952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.514245 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.514576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.515406 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:38.515729 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:38.517294 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0228f2a6-f950-47a3-9653-578ca592c047 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:38.531425 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 430/872] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:38.540632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:38.606188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:38.661534 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4eba49-8b26-41aa-8a31-38f9575c2703 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:38.702089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:38.702722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:38.703008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:38.703278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:38.704169 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=85359b608acd4054af1ef3ea85f3e271) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:38.704487 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:38.705944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba2318a-4a00-4f64-9b92-57892fb31355 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:38.713105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 443/873] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:38 2022] GET /identity/v3/role_assignments?user.id=85359b608acd4054af1ef3ea85f3e271&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:39.522521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e390-8dd9-4414-867d-3731452ebc82 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.523026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e390-8dd9-4414-867d-3731452ebc82 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.523026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875e390-8dd9-4414-867d-3731452ebc82 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.524677 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 431/874] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:39.531138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.531619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.531903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.549236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:39.550438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:39.633330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 444/875] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:39 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:39.657614 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875e390-8dd9-4414-867d-3731452ebc82 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:39.759096 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:39.815124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875e390-8dd9-4414-867d-3731452ebc82 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:39.853847 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:39.855076 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:39.855516 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:39.855994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:39.872540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:39.883732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:39.884719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:39.885591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 432/876] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 17 07:14:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:39.891575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:39.949724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:40.005399 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1e5213-5001-4718-914d-0ef19d5bf37e None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:40.042388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:40.043476 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.044001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.044509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.045486 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:40.046571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:40.048204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3f3f49-3b19-4803-ae37-dc4a9df69317 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:40.058689 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 445/877] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:14:39 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:40.065399 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:40.134490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a75f3-ac00-4363-8b1c-b70a676c5b30 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.134828 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a75f3-ac00-4363-8b1c-b70a676c5b30 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.135058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911a75f3-ac00-4363-8b1c-b70a676c5b30 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.136841 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 446/878] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:40.142523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.142809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.143085 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.161874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:40.163065 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:40.192885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b21456-12a9-422e-afc3-a9750dce0a1c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:40.222270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:40.229037 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:40.230136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.230596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.231044 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.242325 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:40.244046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:40.249463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 447/879] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:40 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:40.266157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:40.267057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:40.267980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:40.267980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:40.267980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:40.267980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:40.270279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 433/880] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:40.271595 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:40.275840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:40.321281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:40.392659 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b791a90d-7a01-4d6e-af00-9ce770c7e4aa None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:40.396687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36e594-726c-470d-bdac-086440bd38ed None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:40.431783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:40.432561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.432848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.433121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.433908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:40.434138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:40.435502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:40.441667 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:40.442635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.443838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.444352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.445871 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:40.447750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:40.448686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 434/881] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:40.454134 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:40.466179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 448/882] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:40 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:40.513358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:40.579507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc43c8e-2429-4149-b7c1-0b780058a6b7 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:40.626064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:40.627347 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.627872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.628422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.636999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:40.638856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:40.666520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:40.667524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:40.668588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:40.669831 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 435/883] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:14:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:40.674750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:40.822453 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:40.826898 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa87ad1-8a8a-4b8b-b2cc-f5a4a033c1d1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:40.868871 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:40.869956 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:40.870449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:40.870931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:40.872031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:40.872551 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:40.874802 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0ae1b-8dac-426a-bcb2-d266a576c411 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:40.897331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 449/884] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 17 07:14:40 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:40.904590 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.055661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde101b-f460-4109-8ab5-dbaf429bd803 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.057576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.077493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b48a5-b7f2-4e20-a173-9134ff10ecf8 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.078219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b48a5-b7f2-4e20-a173-9134ff10ecf8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.078710 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456b48a5-b7f2-4e20-a173-9134ff10ecf8 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.080609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 450/885] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:41.086388 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.086965 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.087545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.096239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bd6eb3-3116-47fc-a7eb-f7e3c76ba91a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.096791 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6eb3-3116-47fc-a7eb-f7e3c76ba91a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.097078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6eb3-3116-47fc-a7eb-f7e3c76ba91a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.097357 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bd6eb3-3116-47fc-a7eb-f7e3c76ba91a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.109831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:41.111610 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:41.186380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd6eb3-3116-47fc-a7eb-f7e3c76ba91a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.188341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bd6eb3-3116-47fc-a7eb-f7e3c76ba91a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.215939 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 451/886] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:41.233059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.309660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.319275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 436/887] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:40 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:14:41.319275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f790-aa09-428c-8d83-58e6aead025d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.319275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f790-aa09-428c-8d83-58e6aead025d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.319275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd6f790-aa09-428c-8d83-58e6aead025d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.319275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 437/888] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:41.323105 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6f790-aa09-428c-8d83-58e6aead025d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.355041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.368711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095bbd5-2059-440f-829a-55be09c6cb4e None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.408904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.410144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.410713 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.410994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.411739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.413229 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-51b474c9-21e4-418e-807b-aed478765cae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:41.426362 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:41.427446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:41.428368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 452/889] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:41.429183 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.429183 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.430106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.443734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd6f790-aa09-428c-8d83-58e6aead025d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.448521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:41.449748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:41.480482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.481271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.481559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.481835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.492862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.494321 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:41.514767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:41.515716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:41.516892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:41.516892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:41.516892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:41.516892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:41.520771 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 438/890] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:41.521657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.528130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 453/891] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:41.529134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.589158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.623356 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.641520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce737a-a74f-4e02-8793-dd70f43d9d17 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.644531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca659b8-57e5-41c2-9d55-5cb87b12d629 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.676178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.676758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.677045 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.677324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.678030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:41.678338 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.679709 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.682212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.683395 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.683856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.684282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.684388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 439/892] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:41.685130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.685382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:41.685924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.687882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.700647 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 454/893] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:41.701493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.800692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297002d-ef2e-4a73-8661-5c602549402a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.816855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.819255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ad120e-0739-4c53-95a4-62b4b7a6f081 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.844976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.846092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.846641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.846923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.847729 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.849799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.853092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:41.853766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:41.854047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:41.854321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:41.855022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:41.855327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:41.856692 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:41.867173 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 455/894] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:41.867173 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:41.867417 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:41.868605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:41.869876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:41.870766 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 440/895] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:41.871670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:41.876307 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:41.974920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32933aa1-0fe8-4d04-8ab3-4d74906e6273 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:41.984774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d160d6b7-25e7-4011-aad0-2b9f7a8ad291 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.009873 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.010601 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.010887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.011174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.018552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.020031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.020230 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.020890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.021335 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.021598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.022354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] RBAC: Adding query filter params (interface=public, service_id=12f475e070924cd4880b81738873f9c8, region_id=RegionOne) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.022849 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.024033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.029618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 441/896] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/endpoints?service_id=12f475e070924cd4880b81738873f9c8&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:42.030736 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:42.038751 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:42.039711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:42.040670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:42.041799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 456/897] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:42.042627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.082875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.113279 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.147638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b2ee4f-5b54-4012-976b-9156e96a76f8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.151818 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8a0601-cf0c-4f29-b223-82958342b1ed None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.188621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.189174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.189462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.189814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.189913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.190127 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.190223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.190409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.190964 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.191099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.191383 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.192487 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.192918 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.206585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 457/898] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/services => generated 1268 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:14:42.206585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.206861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 442/899] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:42.206861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.337626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463c169b-147a-4592-ab90-3fa8b46fabaf None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.348440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.349846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38525fc-ddff-4a59-87ff-cccbaeaabf2b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.384522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.385442 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.385893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.386173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.387128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.387396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.387504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.388838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.395728 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 443/900] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:42.397339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.398031 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.398322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.398604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.399417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.399946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.401258 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789711b-d9d8-4a5d-81e3-0313d9e6c4e9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.416821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 458/901] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:42.423161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:42.541837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3e1f7e-a731-452b-a870-c71d8960efd6 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:42.581495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:42.582170 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.582457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.582738 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.583567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] RBAC: Adding query filter params (role.id=1d00a3ae7a5f4bc3a418563805def99c, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=856489000f7b42f7b7920d13b03a8d6e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:42.583939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:42.585407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e5194e-f53c-4fc4-a77a-99cd32bb56f7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:42.592003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 444/902] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/role_assignments?user.id=856489000f7b42f7b7920d13b03a8d6e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=1d00a3ae7a5f4bc3a418563805def99c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:42.816808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206ca3c-fd4c-4716-ad9a-be0d44f4faf8 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.817322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206ca3c-fd4c-4716-ad9a-be0d44f4faf8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.817430 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1206ca3c-fd4c-4716-ad9a-be0d44f4faf8 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.819002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 459/903] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:42.824541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:42.824835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:42.825114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:42.842736 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:42.843850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:42.879197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:42.927983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 445/904] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:42.946559 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206ca3c-fd4c-4716-ad9a-be0d44f4faf8 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:43.057752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1206ca3c-fd4c-4716-ad9a-be0d44f4faf8 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:43.094023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:43.094831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:43.095118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:43.095398 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:43.096155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:43.097530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:43.112377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:43.113385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:43.114214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:43.114998 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 460/905] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Jun 17 07:14:42 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:43.125783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:43.232604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ec224f-e6f4-42e2-ac40-8ed6da83668f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:43.268038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:43.269072 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:43.269536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:43.269987 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:43.270870 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:43.271360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:43.272975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:43.283679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 446/906] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:43.285306 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:43.343451 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:43.392477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050760ef-fc05-4521-b8a2-71b2373f6ed8 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:43.429576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:43.430593 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:43.431062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:43.431518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:43.432488 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:43.433045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:43.434619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:43.445339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 461/907] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:43.447488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:43.480281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:43.561339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80585a61-15ad-411c-aeef-a23886884202 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:43.599028 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:43.600513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:43.600991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:43.601432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:43.602393 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] RBAC: Adding query filter params (interface=public, service_id=7dfa8cc933ec4db38146653795bf35fb, region_id=RegionOne) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:43.602870 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:43.604435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f507bc-b3d0-49bb-99fa-2c481841a969 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:43.615600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 447/908] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:14:43 2022] GET /identity/v3/endpoints?service_id=7dfa8cc933ec4db38146653795bf35fb&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:43.617148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:43.725653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca7c25-76b8-4fb0-9ca5-35eaa821f202 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:43.744723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:43.765909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21f9ab6-597f-466e-aa67-02e2e10abc6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:43.766635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9ab6-597f-466e-aa67-02e2e10abc6d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:43.766928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9ab6-597f-466e-aa67-02e2e10abc6d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:43.767199 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21f9ab6-597f-466e-aa67-02e2e10abc6d None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:43.767916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f9ab6-597f-466e-aa67-02e2e10abc6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:43.769327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21f9ab6-597f-466e-aa67-02e2e10abc6d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:43.775853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 462/909] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:43 2022] GET /identity/v3/services => generated 1268 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:14:44.516476 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b747e-68c5-4008-ac78-7c0ab491b1c9 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.517202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b747e-68c5-4008-ac78-7c0ab491b1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.517699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00b747e-68c5-4008-ac78-7c0ab491b1c9 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.519553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 448/910] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:44.524462 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b2946-eddb-440e-8c45-1be4bf43f83b None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.525313 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b2946-eddb-440e-8c45-1be4bf43f83b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.525794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6b2946-eddb-440e-8c45-1be4bf43f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.544238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8f6b2946-eddb-440e-8c45-1be4bf43f83b None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:44.545804 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8f6b2946-eddb-440e-8c45-1be4bf43f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:44.619354 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 463/911] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:44.642466 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b747e-68c5-4008-ac78-7c0ab491b1c9 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:44.663092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4383-6d0c-4aea-9b93-195135ec04b2 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.663645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4383-6d0c-4aea-9b93-195135ec04b2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.664639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2d4383-6d0c-4aea-9b93-195135ec04b2 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.666675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 464/912] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:44 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:44.673746 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.674646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.675110 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.696334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:44.697880 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:44.750488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:44.763137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00b747e-68c5-4008-ac78-7c0ab491b1c9 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:44.791819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 465/913] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:44.806443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:44.807603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.808118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.808586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.809477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:44.812029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:44.812332 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:44.827951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:44.829054 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jun 17 07:14:44.829871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:44.833273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 449/914] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:44 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:44.839523 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:44.864933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:44.929940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac9df3a-9722-498f-8cc5-f501d3d08e41 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:44.956147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dadbfd-8f05-406e-a964-3d9d8f9a084f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:44.979785 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09170214-e930-4ab0-b33b-363fc2cffa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:44.980733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09170214-e930-4ab0-b33b-363fc2cffa09 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.981017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09170214-e930-4ab0-b33b-363fc2cffa09 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.981453 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09170214-e930-4ab0-b33b-363fc2cffa09 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.982508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09170214-e930-4ab0-b33b-363fc2cffa09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:44.984489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09170214-e930-4ab0-b33b-363fc2cffa09 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:44.994492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:44.995203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:44.995494 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:44.995792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:44.996503 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:44.996826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:44.998191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.001473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 466/915] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:44 2022] POST /identity/v3/services => generated 241 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:14:45.002978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51ee93-cf57-4231-a9bf-3c9096a56c14 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.003548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51ee93-cf57-4231-a9bf-3c9096a56c14 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.003851 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a51ee93-cf57-4231-a9bf-3c9096a56c14 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.005283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 467/916] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:45.009104 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 450/917] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:44 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:45.014348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.014722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.015013 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.015305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.035157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:45.036667 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:45.044062 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.144423 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 468/918] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:45.155696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bef7a6f-de12-4a4a-8fc6-28124b47f327 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.167033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.201040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.202265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.202556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.202838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.203862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:45.204182 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.205506 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.206899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.214141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 451/919] 10.222.0.58 () {56 vars in 1114 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:45.225695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.305982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1d296d-62b4-462f-b0f6-34dadcb1673d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.340149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.350538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ec3b3-1987-48e1-8580-5db3fdd3666d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.352295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.353227 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.354129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.354129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.365086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:45.373612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:45.374781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:14:45.375864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:45.377938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 469/920] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:45.384283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.401116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.402519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.403216 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.403812 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.405608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.407508 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.432427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 452/921] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:45 2022] POST /identity/v3/endpoints => generated 346 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:14:45.500095 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.515508 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add65600-a296-4019-99db-f8e1f1781d3b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.564052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.565522 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.565998 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.566416 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.567331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:45.567832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.569393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.579919 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 470/922] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:45.589923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.730778 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2190a8-6de9-45fd-8d3d-b967fae44e7a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.769323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.770525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.771016 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.771701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.783684 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:45.788373 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.790267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:45.811620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:45.812676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:45.813570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:45.813570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:45.813570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:45.813570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:45.813570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 453/923] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:45.818574 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:45.937817 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-714ae132-c13a-48e8-8bfa-adf553194440 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:45.980433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:45.981607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:45.981941 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:45.982238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:45.983509 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:45.983846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:45.985242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b409271-0ea4-470e-ad1d-577765ecc111 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:45.999623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 471/924] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:46.004869 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.027538 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445890-4684-4c63-ba31-8f22805c5f2b None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.028146 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445890-4684-4c63-ba31-8f22805c5f2b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.028406 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05445890-4684-4c63-ba31-8f22805c5f2b None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.030092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 472/925] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:46.035264 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.035404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.035693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.048569 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.056032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:46.057396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:46.144705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bc811d-ebf3-4d12-9317-161bb15c0f5a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.149094 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 473/926] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:46.172599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.196974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.198086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.198523 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.198967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.208136 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.209616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:46.227804 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:46.228845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:46.229814 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 454/927] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:46.237104 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.312909 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.322251 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f017928-acc3-48d3-8a89-d33a92ce7ba6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.363812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.364661 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.364947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.365223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.365897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.367296 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.368370 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5529bac-0617-4fab-b326-0f6ae7770d4c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.370342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:46.382665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:46.383684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:46.384627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 474/928] 10.222.0.58 () {56 vars in 1132 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:46.392532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.412400 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.413098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.413379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.413979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.415013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:46.415330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.417119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.448353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 455/929] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:46.456203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.526510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e8d5bb-04d7-43d5-add6-33fc363f85f7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.571440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea10ba09-9828-4a2d-a980-04325a9cf031 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.576340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.577768 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.578053 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.578331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.579074 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:46.579383 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.580767 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.586009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.591807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 475/930] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:46.595796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.617147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.617969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.618260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.618544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.631802 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.633443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:46.654513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:46.655482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:46.656424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:46.656424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:46.656424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:46.656424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:46.656424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 456/931] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:46.663641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.687390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.749754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9fd43b-20a3-4a77-9d76-d8185bd8d3f4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.788867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.789553 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.789839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.790137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.790840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:46.791150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.792628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.798942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 476/932] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:46.804761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.815688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5b748a-a03e-4768-837e-6457de80a8fd None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.865894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.867095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.867553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.867996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.869163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:46.870007 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.872101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:46.894823 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 457/933] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:46.895953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:46.925681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.933675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031d74e-e9b5-4611-a5b5-061df783bd00 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:46.969476 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:46.981262 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:46.982294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:46.983322 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:46.983820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:46.984770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:46.986899 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.012623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 477/934] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:46 2022] POST /identity/v3/endpoints => generated 347 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:47.023421 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1daebf8-3ae6-48de-ad1b-0ec8ef34eeab None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.072322 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.073570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.074103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.074740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.086610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.088805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:47.106397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:47.107364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:47.108871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:47.111470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 458/935] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:47.118294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.241527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41e0b1e-6d2d-4539-9438-c8bb7d2e9a28 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.283840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.284475 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.284759 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.285034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.285830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:47.286142 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.287605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b491c88-5500-4b83-88c6-dba13bdf9918 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.304032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 478/936] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:47.310222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.376647 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba89ab7-1ea7-41a4-a2fc-ff5ecdfaca2a None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.376974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba89ab7-1ea7-41a4-a2fc-ff5ecdfaca2a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.377216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba89ab7-1ea7-41a4-a2fc-ff5ecdfaca2a None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.378846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 479/937] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:47.384205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.384500 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.384785 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.397034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.403576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:47.405478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:47.422955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e03c8-1900-456c-b3ff-86ee8ff54a4f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.459295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.459945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.460229 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.460511 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.460788 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/856489000f7b42f7b7920d13b03a8d6e/roles/1d00a3ae7a5f4bc3a418563805def99c` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.463158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=856489000f7b42f7b7920d13b03a8d6e, role_id=1d00a3ae7a5f4bc3a418563805def99c)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.464652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.480983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 459/938] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:14:47 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/856489000f7b42f7b7920d13b03a8d6e/roles/1d00a3ae7a5f4bc3a418563805def99c => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:14:47.499336 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 480/939] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:47.521654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.657193 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcda895-612e-485a-ba35-9573b9a32f16 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.697533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.698751 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.699038 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.699318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.700014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.701965 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f6e30069-ae72-40f6-9838-9188c3666ad8 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:47.714562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:47.715832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:47.716882 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 460/940] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:47.723646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.805033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008377de-810c-4ad1-a9c1-22a022f8128c None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.805286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008377de-810c-4ad1-a9c1-22a022f8128c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.805527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008377de-810c-4ad1-a9c1-22a022f8128c None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.807255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 461/941] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:47.813771 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.814064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.814348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.819541 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:47.835377 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:47.836937 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:47.844867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc0fbf3-e230-432a-b70a-82dc311bc532 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:47.881137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:47.881833 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:47.882131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:47.882398 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:47.883119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:47.883427 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:47.884855 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:47.891299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 481/942] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:47.896737 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.929567 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 462/943] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:47.953426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:47.956718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:48.022840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef9c9c-1bea-463a-b44c-80e3e9a1028e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:48.062021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:48.063140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:48.063606 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:48.064079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:48.065078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:48.065574 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:48.067182 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:48.078663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 482/944] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:48.079954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:48.082168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a934e-f275-4ada-85b2-0a8b9c1dbdbd None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:48.118276 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:48.124553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:48.125244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:48.125897 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:48.126986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:48.127330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:48.129323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:48.130777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: WARNING keystone.server.flask.common [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 07:14:48.153199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.sql.core [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 07:14:48.153199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 07:14:48.153199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [parameters: {'id': '2c077484879441418e6680b945797e0a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 07:14:48.153199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80080) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c077484879441418e6680b945797e0a.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c077484879441418e6680b945797e0a. Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:14:48.158837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result.read() Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jun 17 07:14:48.159708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return project_ref.to_dict() Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application yield resource Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise self.value Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application session.commit() Jun 17 07:14:48.160685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.session.flush() Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application compat.raise_( Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 07:14:48.161576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application c = connection._execute_20( Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 07:14:48.162477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application result.read() Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:14:48.163268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [parameters: {'id': '2c077484879441418e6680b945797e0a', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:48.164163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:48.164949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.Conflict( Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c077484879441418e6680b945797e0a. Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 463/945] 10.222.0.58 () {60 vars in 1140 bytes} [Fri Jun 17 07:14:47 2022] POST /identity/v3/projects => generated 262 bytes in 209 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:48.167385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:48.225760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd47401-134f-40e1-b576-df484aeb23e5 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:48.227666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:48.271832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:48.272750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:48.273039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:48.273326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:48.274433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] RBAC: Adding query filter params (interface=public, service_id=674b3fa5b7fd492387712970f0153acb, region_id=RegionOne) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:48.274756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:48.276771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:48.289463 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 483/946] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:14:48 2022] GET /identity/v3/endpoints?service_id=674b3fa5b7fd492387712970f0153acb&interface=public®ion_id=RegionOne => generated 194 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:48.290793 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:48.311887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa77c4-b2b6-49df-a609-fb60c553b3a4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:48.354960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:48.356454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:48.357148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:48.358571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:48.368639 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:48.371566 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:48.402488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:48.404565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:48.406389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 464/947] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:48.410722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:48.416655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83320703-3880-4e7d-8515-dee89cd780f7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:48.465922 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007162a2-e4a0-42e0-b5b7-0422f5496333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:48.467923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007162a2-e4a0-42e0-b5b7-0422f5496333 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:48.467923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007162a2-e4a0-42e0-b5b7-0422f5496333 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:48.467923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007162a2-e4a0-42e0-b5b7-0422f5496333 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:48.468255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007162a2-e4a0-42e0-b5b7-0422f5496333 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:48.470349 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-007162a2-e4a0-42e0-b5b7-0422f5496333 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:48.473162 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:48.483897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 484/948] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:48 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:14:48.543150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6335afa8-1bf1-4e1b-8e9b-8cf2a8ff62d9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:48.584427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:48.585520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:48.586012 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:48.586516 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:48.587509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:48.588075 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:48.589761 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a25ee-066b-458c-92a0-6f594c6a705b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:48.613638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 465/949] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:48 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:49.339995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3bb7-f406-48a3-abab-f0e0f2c9e7a4 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.340511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3bb7-f406-48a3-abab-f0e0f2c9e7a4 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.340589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4a3bb7-f406-48a3-abab-f0e0f2c9e7a4 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.342263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 485/950] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:49.347740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b44f0-72bc-4881-9065-b895376005aa None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.348177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b44f0-72bc-4881-9065-b895376005aa None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.348323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b44f0-72bc-4881-9065-b895376005aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.365423 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-788b44f0-72bc-4881-9065-b895376005aa None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:49.366990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-788b44f0-72bc-4881-9065-b895376005aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:49.445973 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 466/951] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:49.468156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3bb7-f406-48a3-abab-f0e0f2c9e7a4 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.499735 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.580264 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4a3bb7-f406-48a3-abab-f0e0f2c9e7a4 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.620777 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.621588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.621872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.622152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.622866 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.624398 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3b403b14-1450-4358-8b8d-0948a3908a43 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:49.636706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:49.637747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:49.640312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 486/952] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:49.643895 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b44f0-72bc-4881-9065-b895376005aa None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.689080 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.760155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b44f0-72bc-4881-9065-b895376005aa None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.799337 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.800050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.800518 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.800758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.803010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e314-bc2f-4a0d-b9e0-752f7e83f464 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.803436 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e314-bc2f-4a0d-b9e0-752f7e83f464 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.803718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d27e314-bc2f-4a0d-b9e0-752f7e83f464 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.805337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 487/953] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:49.805556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:49.806765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.807163 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.811792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.812247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.812776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.813292 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 467/954] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:49.818450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.843046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:49.844375 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:49.921631 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 488/955] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:49.936323 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1648e2-2914-45b4-8d61-ea2d84f50cf9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:49.938206 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.945133 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:49.972818 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:49.979691 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:49.980680 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:49.981118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:49.981545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:49.982525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] RBAC: Adding query filter params (type=compute) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:49.983085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:49.984731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:49.990122 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 468/956] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:50.057635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987cff39-e843-4d6f-bdcc-62b28554c43a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.096092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.096934 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.097220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.097496 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.109307 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:14:50.117877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:50.119126 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:50.120233 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 489/957] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 17 07:14:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:50.129861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.254890 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda22750-32fd-44f5-89b8-dd37ca7697dd None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.292516 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.293575 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.294070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.294553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.295543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:50.296100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:50.297782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:50.309396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 469/958] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:14:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:50.315780 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.415557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:50.428624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21420a41-5827-442a-a9c4-ff83fcc44385 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.464481 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.465283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.465568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.465845 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.476952 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:50.478409 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:50.496604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:50.497561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:50.499495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:50.499495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:50.499495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:50.499495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:50.499495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 490/959] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:50.506200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.537848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:50.620514 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce66ecd-85be-4786-b686-8cf5bf88c32a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.655918 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.656826 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.657261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.657712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.658589 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:50.659042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:50.660865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e4afdb-b977-46d6-b5e6-baadfd236d14 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:50.674110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 470/960] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:50.679680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.791485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e7b49e-fc6f-4f8d-92e0-a36547727d23 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:50.825377 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1c7e-b395-452b-8b92-d35fddbe0bf6 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.825726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1c7e-b395-452b-8b92-d35fddbe0bf6 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.826016 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac1c7e-b395-452b-8b92-d35fddbe0bf6 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.827679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 471/961] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:50.831544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:50.832502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.832822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.833015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.834669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c3e4c-5bb6-4300-b5cb-6424f5540580 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.834960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c3e4c-5bb6-4300-b5cb-6424f5540580 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.835240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230c3e4c-5bb6-4300-b5cb-6424f5540580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.838750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:50.846351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:50.848327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:50.854325 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-230c3e4c-5bb6-4300-b5cb-6424f5540580 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:50.855548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-230c3e4c-5bb6-4300-b5cb-6424f5540580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:50.866063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:50.867108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jun 17 07:14:50.868489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:50.872238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 491/962] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:14:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:50.873663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:50.936329 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 472/963] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:50.937671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26c535-47da-40ab-81f7-537169f092d2 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.937964 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26c535-47da-40ab-81f7-537169f092d2 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.938246 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26c535-47da-40ab-81f7-537169f092d2 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.939517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 473/964] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:50.944694 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:50.944983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:50.945260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:50.964495 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:50.965700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:50.981684 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:50.992160 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1817b69e-18f4-4766-a881-8e8e722e06d6 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.031164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.032171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.032467 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.033014 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.033859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:51.034311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.036360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.039794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 474/965] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:51.040557 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.069502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 492/966] 10.222.0.58 () {56 vars in 1149 bytes} [Fri Jun 17 07:14:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:51.070716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.129120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.147501 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a76415-7a43-44fe-8cc7-4e080f1e6d3b None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.178187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e680bf-5752-4563-ad66-5452eef2e939 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.191051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.191901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.192191 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.192470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.193370 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.194758 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:51.207933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:51.209033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:51.209893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 475/967] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:51.211676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.221193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.222318 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.222838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.223350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.224633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.226836 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.229044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: WARNING keystone.server.flask.common [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jun 17 07:14:51.241947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.243219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.sql.core [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 07:14:51.243219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 07:14:51.243219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [parameters: {'user_id': '28414a4fb03547c3abd072cf390531cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 07:14:51.243219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80079) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application result.read() Jun 17 07:14:51.265149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:14:51.266096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application yield resource Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application next(self.gen) Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self.session.rollback() Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self.force_reraise() Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise self.value Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application session.commit() Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jun 17 07:14:51.267051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._prepare_impl() Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self.session.flush() Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._flush(objects) Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application compat.raise_( Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application flush_context.execute() Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rec.execute(self) Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jun 17 07:14:51.268077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application _emit_insert_statements( Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application result = connection._execute_20( Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ret = self._execute_context( Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jun 17 07:14:51.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self.dialect.do_execute( Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application result = self._query(query) Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application conn.query(q) Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application result.read() Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jun 17 07:14:51.269840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application packet.raise_for_error() Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [parameters: {'user_id': '28414a4fb03547c3abd072cf390531cb', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:51.270856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jun 17 07:14:51.271690 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 493/968] 10.222.0.58 () {60 vars in 1131 bytes} [Fri Jun 17 07:14:51 2022] POST /identity/v3/users => generated 160 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:51.273495 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.350934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1ede7-914b-4d44-9a8d-ee86a59fc54c None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.385247 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.385830 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.386121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.386354 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ba06cf-4fb0-473c-aa2d-bb631565bc9e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.386460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.405124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.425781 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.426489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.426739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.427014 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.427728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:51.428067 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.429619 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.441858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 494/969] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:51.441858 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.466519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.468839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.483330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.547555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee469b0-298c-4561-9b57-61fd413fc99e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.573448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 476/970] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:14:51.574304 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.588670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.589636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.590024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.590405 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.598755 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.600307 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:14:51.614750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:51.615942 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jun 17 07:14:51.617139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.624210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 495/971] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/users/cinder => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:51.624210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.667544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.693111 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4cba125-3000-4388-969f-bf9e9c58420b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.708004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.731343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.732044 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.732331 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.732634 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.733337 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:51.733646 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.734418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862f9343-c646-4a45-85af-44e42d4f6120 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.735019 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.745043 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 477/972] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:51.745043 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.776282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.777147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.777433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.777976 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.789346 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.790908 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:14:51.810063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:51.811540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:51.817196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:14:51.817196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:14:51.817196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:14:51.817196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:51.817196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 496/973] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:51.817196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.857811 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e25e916-b77d-4e6a-8cc7-20e521c6cc68 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.894124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.894806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.895093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.895374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.896214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:51.896533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.898006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:51.914350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.929548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4cf01e-b19e-4ead-81f1-763c87e75097 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:51.947798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 478/974] 10.222.0.58 () {56 vars in 1101 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:51.947798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:51.981646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:51.983009 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:51.983820 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:51.984174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:51.984594 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:51.985431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:51.986897 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.012022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 497/975] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:51 2022] POST /identity/v3/endpoints => generated 349 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:52.094892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f98ac3-d3db-44f0-9004-3d9113aa33d2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.150416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.151119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.151408 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.151691 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.152726 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:52.153050 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.155041 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8289f-ec47-4a9a-adfb-8c06ffbcda66 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.174167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 479/976] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:52.182842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:52.237153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f11c-0a9d-4945-bc58-1e8af7dae7cc None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.237461 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f11c-0a9d-4945-bc58-1e8af7dae7cc None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.237721 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f313f11c-0a9d-4945-bc58-1e8af7dae7cc None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.239402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 480/977] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:52.244872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.245471 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.245960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.271187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:52.272446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:52.306528 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea74d5f-cb7a-402b-bc00-c216f245d461 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.344829 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.345637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.345920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.346197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.347410 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 481/978] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:52.354148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.355585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.370070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:14:52.370876 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:52.371756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:52.376628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 498/979] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:52.379560 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:52.391633 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:52.392943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:52.479742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a38234-d310-46ab-b795-bf90b67e2c50 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.490286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74af6280-bb44-4e2a-ae08-7187d9c6e6c3 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.515001 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.515670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.515982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.516273 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.516983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.518346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.525375 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.526062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.526415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.526693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.527794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:52.528116 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.530072 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31777a08-9088-49b8-a09d-0bf740223ff9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.540467 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 482/980] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:52 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:14:52.547201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 499/981] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:14:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:52.553770 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:52.645450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:52.677633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb12f82-6bb0-4e73-84ca-d32f22e2ae8f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:52.715823 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:52.716596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:52.717464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:52.717744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:52.718582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] RBAC: Adding query filter params (role.id=1d00a3ae7a5f4bc3a418563805def99c, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=856489000f7b42f7b7920d13b03a8d6e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:52.718904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:52.720382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9814ed83-0033-4052-bf08-a65c602e87a4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:52.726832 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 483/982] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:14:52 2022] GET /identity/v3/role_assignments?user.id=856489000f7b42f7b7920d13b03a8d6e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=1d00a3ae7a5f4bc3a418563805def99c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:54.222656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079463-ae49-498b-b165-fc86d63c7ea6 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.223174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079463-ae49-498b-b165-fc86d63c7ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.223281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38079463-ae49-498b-b165-fc86d63c7ea6 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.224753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 500/983] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:54.229698 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.230114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.230278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.247347 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:54.249162 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:54.323752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 484/984] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:54.343497 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38079463-ae49-498b-b165-fc86d63c7ea6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:54.416321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:54.454189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38079463-ae49-498b-b165-fc86d63c7ea6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:54.492191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:54.493022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.493308 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.493584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.494250 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:54.495616 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:54.508225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:54.509277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:14:54.510333 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 501/985] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:54 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:54.516034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:54.587412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:54.621015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05336c8e-52c7-4d28-a193-2bcdda44cf99 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:54.660947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:54.661647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.661933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.662233 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.663008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:54.663321 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:54.664820 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68c577-6778-4507-b487-6d6c77d38a04 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:54.670757 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 485/986] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:54 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:54.676104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:54.705989 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96dd4f-29fe-4d5a-ad67-0df5b6e6b97d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.706279 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96dd4f-29fe-4d5a-ad67-0df5b6e6b97d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.706559 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d96dd4f-29fe-4d5a-ad67-0df5b6e6b97d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.708214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 486/987] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:14:54.712868 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.713157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.713436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.732510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:54.733696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:54.804323 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c5c303-aba1-4525-81d2-7963ceb84fcd None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:54.810268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 487/988] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:54 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:14:54.833486 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:54.848860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:54.856181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:54.856863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.857359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.858120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.858836 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:54.859143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:54.860537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:54.866141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 502/989] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:54 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:54.872347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:54.915688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:54.958960 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b33ccc0-68c6-4810-97cf-1f3e9dca4936 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:54.984138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e99ec-9666-4a42-8d4d-e5c8fd201653 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:54.994467 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:54.995274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:54.995561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:54.995876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:54.996534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:54.997949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-e26a030e-29c8-43be-bae2-4d52503fd75a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:55.009608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:55.010795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:55.011655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 488/990] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:55.012493 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9fff-a3fa-4c83-b670-6a4f85751c3d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.012493 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9fff-a3fa-4c83-b670-6a4f85751c3d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.012757 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0d9fff-a3fa-4c83-b670-6a4f85751c3d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.014580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 489/991] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:55.017127 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9fff-a3fa-4c83-b670-6a4f85751c3d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.021996 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.022663 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.022944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.023213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.024042 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] RBAC: Adding query filter params (interface=admin, service_id=674b3fa5b7fd492387712970f0153acb, region_id=RegionOne) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:55.024353 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.025711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b9c5d-2562-44d5-a83c-d88f48470eb0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.032587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 503/992] 10.222.0.58 () {56 vars in 1249 bytes} [Fri Jun 17 07:14:54 2022] GET /identity/v3/endpoints?service_id=674b3fa5b7fd492387712970f0153acb&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:55.033791 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.034078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.034573 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.051271 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:55.052844 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:55.116893 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:55.126600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0d9fff-a3fa-4c83-b670-6a4f85751c3d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.128972 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 504/993] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:55 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:55.129912 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.158470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:55.167093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.167778 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.168073 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.168351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.169081 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:55.169393 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.170765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.175502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 490/994] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:55.176318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.240916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f291d9b1-fd2a-41dc-a514-45aa0dc0c5d5 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.278827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.280120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.280418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.280700 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.281222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a02b17-1fd1-4297-94bd-053306ecc893 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.281659 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.282761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.289396 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 505/995] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:14:55.290138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.319274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.320132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.320551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.320833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] PATH_INFO: `/v3/services/image` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.321508 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.323000 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:55.337385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:55.339131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:14:55.340821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:55.344626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 491/996] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:55.345628 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.374118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:55.421158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:55.431029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468c856-ccac-495d-82a1-5687741fdcda None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.476685 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.476894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23d35c-60ab-4c79-b4bf-53223b7a9b93 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.477184 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.477973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.477973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.478884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:55.479799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.481205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.488924 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 506/997] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:55.495284 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.514821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.515502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.515813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.516096 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.516810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:55.517120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.518502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.524475 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 492/998] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:55.530129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.607835 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d606a0-8ce2-477c-8522-f4e73fb5221e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.629226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:55.638296 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e101734-f35c-409c-a721-7c153a9be8c5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.653313 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.654476 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.654762 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.655311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.656171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] RBAC: Adding query filter params (interface=public, service_id=5cf56646184245bd9aa956e0142ff2ea, region_id=RegionOne) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:55.656713 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.658477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.660887 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:55.665403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 507/999] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/endpoints?service_id=5cf56646184245bd9aa956e0142ff2ea&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:55.671245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:55.679132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.680239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.680533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.680812 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.681519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] RBAC: Adding query filter params (type=image) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:55.681829 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.683934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b5239-53f0-4aa1-b079-e17ac8364255 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.699794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 493/1000] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:55.799118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f79df1-8418-490d-8864-58deec74bf83 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:55.838530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9292b2-867f-4caf-8a5c-2f1d352fff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:55.839231 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9292b2-867f-4caf-8a5c-2f1d352fff29 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:55.839521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9292b2-867f-4caf-8a5c-2f1d352fff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:55.839827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9292b2-867f-4caf-8a5c-2f1d352fff29 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:55.840537 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9292b2-867f-4caf-8a5c-2f1d352fff29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:55.842002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9292b2-867f-4caf-8a5c-2f1d352fff29 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:55.855793 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 508/1001] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:14:55 2022] GET /identity/v3/services => generated 1727 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:14:57.474810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539572f4-baea-4569-9786-3737dd9ac529 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.475519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539572f4-baea-4569-9786-3737dd9ac529 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.475679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539572f4-baea-4569-9786-3737dd9ac529 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.478380 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 494/1002] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:57.484198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.484672 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.484752 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.501514 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:57.502711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:57.551418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.578973 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 509/1003] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:57.601215 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539572f4-baea-4569-9786-3737dd9ac529 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.709529 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539572f4-baea-4569-9786-3737dd9ac529 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.743571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.744333 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.744618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.744893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.745549 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.746933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-666f02b2-b476-4ff9-88a7-1e0105bd1410 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:57.760512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:57.761779 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jun 17 07:14:57.762794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:57.767571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 495/1004] 10.222.0.58 () {56 vars in 1126 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:14:57.769143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.838669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b0e2-91bb-4c53-afa8-fbe7ea6536b4 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.838956 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b0e2-91bb-4c53-afa8-fbe7ea6536b4 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.839237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd91b0e2-91bb-4c53-afa8-fbe7ea6536b4 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.840925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 496/1005] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:57.846197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.846498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.846782 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.864805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:57.866371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:57.877940 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc403e0-cb16-4f06-8de2-bf62f257c0f1 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:57.915478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:57.917461 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:57.918477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:57.918683 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:57.919041 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:57.920347 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:57.920660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:57.922078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:57.927650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 510/1006] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:57.934048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.947497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 497/1007] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:57 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:57.970866 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:57.986491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.046266 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e012b-6fd9-44b0-962d-525c689581eb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.071388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303e3211-6cd4-41d6-ae19-69c446572d74 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.079977 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.080652 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.080928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.081197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.081903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:58.082209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.083563 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cffe631-b29b-4375-be7b-3d4018441059 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.088527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 511/1008] 10.222.0.58 () {56 vars in 1122 bytes} [Fri Jun 17 07:14:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:58.089805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54e9a-149a-4cee-b911-3596f197ab30 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.090096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54e9a-149a-4cee-b911-3596f197ab30 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.090374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb54e9a-149a-4cee-b911-3596f197ab30 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.091833 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 512/1009] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:14:58.096470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54e9a-149a-4cee-b911-3596f197ab30 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.106437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e9f42d-e9ef-498e-9a9f-93a6476f6995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.107648 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9f42d-e9ef-498e-9a9f-93a6476f6995 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.107975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9f42d-e9ef-498e-9a9f-93a6476f6995 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.108256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e9f42d-e9ef-498e-9a9f-93a6476f6995 None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.108986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9f42d-e9ef-498e-9a9f-93a6476f6995 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.110377 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e9f42d-e9ef-498e-9a9f-93a6476f6995 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.127584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 498/1010] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:14:57 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:14:58.129021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.129264 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.129470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.156065 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:14:58.157324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:14:58.194586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.262115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 499/1011] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:14:58 2022] POST /identity/v3/auth/tokens => generated 1656 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:14:58.263221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb54e9a-149a-4cee-b911-3596f197ab30 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.268993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.285865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.310265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.311401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.311701 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.312020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.312794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.314185 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.332776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 513/1012] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:58 2022] POST /identity/v3/endpoints => generated 325 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:14:58.411305 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939ff8d8-7d7e-4aa2-96bf-64a7b12e5aa8 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.458719 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.459540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.459848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.460123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] PATH_INFO: `/v3/services/compute` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.460778 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.462207 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:14:58.475295 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:14:58.476855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:14:58.482944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 500/1013] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/services/compute => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:14:58.485607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.602987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279cc059-6379-40f1-838a-4d9309b9c4d2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.640138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.641081 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.641532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.641824 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.642588 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:58.642899 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.644309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.650595 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 514/1014] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:14:58.659127 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.687300 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.770285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8e4ea6-1380-4ed2-b750-d93ebc1f0e9a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.807524 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.808384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.808793 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.809178 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.809993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] RBAC: Adding query filter params (type=compute) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:14:58.810980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.812484 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2373b7d-17ce-48c3-8130-619780123c3e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:58.822631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 501/1015] 10.222.0.58 () {56 vars in 1112 bytes} [Fri Jun 17 07:14:58 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:14:58.824359 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:14:58.856691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:14:58.941209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7811294a-a8c1-49fd-97ed-9cdeab4e46fb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:14:58.976697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d28f85e-aded-4eca-b5f0-9f365597e1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:14:58.977370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f85e-aded-4eca-b5f0-9f365597e1df None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:14:58.977658 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f85e-aded-4eca-b5f0-9f365597e1df None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:14:58.977933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d28f85e-aded-4eca-b5f0-9f365597e1df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:14:58.978677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f85e-aded-4eca-b5f0-9f365597e1df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:14:58.980073 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d28f85e-aded-4eca-b5f0-9f365597e1df None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:14:59.001598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 515/1016] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:14:58 2022] POST /identity/v3/endpoints => generated 334 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:00.571600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a297d0-1cd3-4254-93c7-a80d8a85d594 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.572143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a297d0-1cd3-4254-93c7-a80d8a85d594 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.572143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a297d0-1cd3-4254-93c7-a80d8a85d594 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.574108 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 502/1017] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:00.582141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.582673 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.583119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.615999 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:00.617756 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:00.686749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77ada-ef36-478a-8692-15a84080ee9d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.687375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77ada-ef36-478a-8692-15a84080ee9d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.687650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df77ada-ef36-478a-8692-15a84080ee9d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.689302 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 503/1018] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:00.695348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.695641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.695956 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.713051 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:00.714370 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:00.718193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 516/1019] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:00.740944 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:00.757501 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:00.807235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 504/1020] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:00 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:00.832222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:00.852751 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:00.885744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b135d-adf2-4cb7-8877-4dfd4356712a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:00.926920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:00.928739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:00.929425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:00.929961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] PATH_INFO: `/v3/services/image` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:00.930649 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:00.932279 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:00.945585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:00.946916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:00.948525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 517/1021] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Jun 17 07:15:00 2022] GET /identity/v3/services/image => generated 86 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:00.953518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:00.963598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5969dd56-ae86-4d38-9b71-dc6bfa3b3672 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.007705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.008543 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.008825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.009101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.010519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.012006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.014488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 505/1022] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:01.021420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.062074 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:01.107370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7980a73-d15b-420d-9c25-6234f0c92156 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.163325 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:01.178265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.179684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.180153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.180577 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.181683 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:01.182152 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.182359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b75351-97de-49df-bbb7-dff812bf1761 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.184368 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.193348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 518/1023] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:00 2022] GET /identity/v3/services?name=image => generated 122 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:01.201895 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.228469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.229436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.229911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.230526 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.231661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.233423 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.265953 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 506/1024] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:15:01 2022] POST /identity/v3/projects => generated 311 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:01.363927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd78903-49e2-4dbb-a869-8622bc8552c6 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.419079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.420113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.420618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.421087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.422003 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] RBAC: Adding query filter params (type=image) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:01.422478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.424096 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72c00d1f-8e61-4072-b271-6a23428bb479 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.431469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 519/1025] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:01 2022] GET /identity/v3/services?type=image => generated 350 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:01.440729 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.604555 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e0ed3-19e4-4fc7-9ff6-38eb0a9f40b7 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.605173 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e0ed3-19e4-4fc7-9ff6-38eb0a9f40b7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.605417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6e0ed3-19e4-4fc7-9ff6-38eb0a9f40b7 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.607664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 520/1026] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:01.609341 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3ab1c6-fb8e-45f4-95ee-97d838962896 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.613784 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.614123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.614352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.619591 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:01.633967 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:01.635178 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:01.664994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.666223 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.666664 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.667339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.667985 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] RBAC: Adding query filter params (interface=public, service_id=6b8373486e854ac78de792eb0c8ef0e7, region_id=RegionOne) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:01.668307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.670312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.683438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 507/1027] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:15:01 2022] GET /identity/v3/endpoints?service_id=6b8373486e854ac78de792eb0c8ef0e7&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:01.684650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.690507 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:01.728156 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 521/1028] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:01.754385 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:01.849710 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c78dd0-895f-4564-87de-5bd44e3e1736 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.921185 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.922318 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.922775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.923235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:01.924425 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:01.926695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:01.947875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 508/1029] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:15:01 2022] GET /identity/v3/services => generated 1957 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jun 17 07:15:01.948151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0023fb-8ddb-4815-84b3-2e88fd85dfe5 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:01.990516 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:01.996747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:01.998178 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:01.998477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:01.998725 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.015691 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:02.030464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:02.036100 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:02.037586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 522/1030] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 17 07:15:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:02.039307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.134659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.190354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78226c65-5bdf-4a6c-9083-cc8ec745e1cd None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.257654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.258352 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.258638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.258917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.259684 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:02.260030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:02.261452 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:02.273999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 509/1031] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:02.280721 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.416951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2e8e1e-c280-4965-8429-5d486a96f96a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.460155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.461112 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.461569 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.462039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.475566 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:02.477277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:02.499433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:02.500459 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:02.501393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:02.501393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:02.501393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:02.501393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:02.501393 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 523/1032] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:02.504806 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.636033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32c68b1-0cfc-4b41-93a2-bfe2627d6ea5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.673389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.687502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.688253 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.688535 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.688821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.689542 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:02.689852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:02.691244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:02.706382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 510/1033] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:02.712855 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:02.774579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:02.850902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943547c4-63fc-44f8-83d2-9ab4aa3cf564 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:02.896437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:02.897738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:02.898164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:02.898571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:02.909904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:02.911464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:02.930512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:02.932872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:02.934903 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:02.937539 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 524/1034] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:02.939419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.085983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e86cb0c-768a-439d-9256-8a29170822bc None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.142087 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.143141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.143602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.144092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.145515 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:03.146020 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.148536 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.180364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 511/1035] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:15:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:03.182341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.329343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07783672-2a6b-4225-b90e-3f868ed116a7 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.332102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.370901 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc6e421-3f44-4d34-ba40-c51fdf4fe99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.371677 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e421-3f44-4d34-ba40-c51fdf4fe99c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.372144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e421-3f44-4d34-ba40-c51fdf4fe99c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.373091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc6e421-3f44-4d34-ba40-c51fdf4fe99c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.457982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e421-3f44-4d34-ba40-c51fdf4fe99c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.460267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc6e421-3f44-4d34-ba40-c51fdf4fe99c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.631854 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 525/1036] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:03.633604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.707483 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.779203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89868c8a-b599-4ac5-8315-044844461886 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:03.820885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcc1bc-06bc-40c3-934d-40624acb9be6 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.821779 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcc1bc-06bc-40c3-934d-40624acb9be6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.821779 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fcc1bc-06bc-40c3-934d-40624acb9be6 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.823103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 526/1037] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:03.826156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:03.827910 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.828455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.828610 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:03.828904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:03.829125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.829226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:03.836532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:03.845746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:03.847238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:03.849659 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:03.850492 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:03.868550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:03.870026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:03.871731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:03.871731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:03.871731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:03.871731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:03.871731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 512/1038] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:03.876753 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:03.951321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 527/1039] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:03 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:03.978449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.015049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.020374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516e0146-beeb-47c1-8e01-1c65fb82b36e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.070161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.070855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.071144 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.071423 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.072196 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:04.072511 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.073911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.095711 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 513/1040] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:04.105405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.135853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141b07d-7c6d-433f-8cbb-6b17e31db15a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.186770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.187628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.188022 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.188298 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.189811 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.191309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.193771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 528/1041] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:04.201612 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.204870 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.246765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdd7a41-44e3-45ed-ba8e-d108df723f43 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.286068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded51327-af22-406c-8473-f4925778959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.286873 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51327-af22-406c-8473-f4925778959f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.287156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51327-af22-406c-8473-f4925778959f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.287430 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded51327-af22-406c-8473-f4925778959f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.301892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51327-af22-406c-8473-f4925778959f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.303554 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded51327-af22-406c-8473-f4925778959f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ded51327-af22-406c-8473-f4925778959f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:04.321620 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:04.323457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:04.324545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 514/1042] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:04.325063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543515e9-54b8-4847-8353-760925b6692d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.325063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543515e9-54b8-4847-8353-760925b6692d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.325345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543515e9-54b8-4847-8353-760925b6692d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.327177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 515/1043] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:04.330218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543515e9-54b8-4847-8353-760925b6692d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.336483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56762580-ce6f-48ce-b527-e3cc43aa08ee None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.351962 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.372028 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa8face-fdf8-4999-8730-0065e036b79d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.373246 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8face-fdf8-4999-8730-0065e036b79d None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.373533 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8face-fdf8-4999-8730-0065e036b79d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.373813 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa8face-fdf8-4999-8730-0065e036b79d None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.374545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8face-fdf8-4999-8730-0065e036b79d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.376017 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa8face-fdf8-4999-8730-0065e036b79d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.396978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 529/1044] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:04 2022] POST /identity/v3/users => generated 285 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:04.398728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.399033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.399319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.417949 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:04.419272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:04.463044 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543515e9-54b8-4847-8353-760925b6692d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.502377 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.516451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.517248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.517979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.517979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.518713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:04.519017 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.520589 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.534890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 530/1045] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:04 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:04.535140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 516/1046] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:04.541268 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.554992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.667906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3d538-5999-404f-8f0e-e73392bed8f7 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.678214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.709312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935d3c1-2302-4b43-9fd9-4fa88282342e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.715878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.716134 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.717311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.717311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.718077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] RBAC: Adding query filter params (role.id=1d00a3ae7a5f4bc3a418563805def99c, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=4f968a9c3d3d4dbfb71216af67cd291e) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:04.718308 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.719729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.725884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 531/1047] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/role_assignments?user.id=4f968a9c3d3d4dbfb71216af67cd291e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=1d00a3ae7a5f4bc3a418563805def99c => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.756329 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.757164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.757455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.757730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] PATH_INFO: `/v3/services/image` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.758521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.760280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:04.774850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:04.783133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:04.784240 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 517/1048] 10.222.0.58 () {56 vars in 1105 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/services/image => generated 86 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:04.785200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:04.851449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:04.911667 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed827c-8c4b-4ef0-996c-6cdbff9dac97 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:04.957863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:04.958915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:04.959417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:04.960006 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:04.961174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] RBAC: Adding query filter params (name=image) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:04.961669 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:04.964296 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:04.974194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 532/1049] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/services?name=image => generated 122 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:04.980061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.094095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3887373a-7ef0-4097-b44d-af72acd25ed8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.134561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.135405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.135697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.136005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.136799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] RBAC: Adding query filter params (type=image) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:05.137112 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.139217 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c6d595-9d40-479e-878b-e50db350211b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.146597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 518/1050] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:04 2022] GET /identity/v3/services?type=image => generated 350 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:05.153626 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:05.284063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74d8796-0e15-47ad-8bbb-ea68c7c9843d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:05.305418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:05.328477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6091fac5-a901-4b76-89ea-346d49eb0368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:05.329410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091fac5-a901-4b76-89ea-346d49eb0368 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:05.329689 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091fac5-a901-4b76-89ea-346d49eb0368 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:05.329979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6091fac5-a901-4b76-89ea-346d49eb0368 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:05.330750 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091fac5-a901-4b76-89ea-346d49eb0368 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:05.332194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6091fac5-a901-4b76-89ea-346d49eb0368 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:05.360559 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 533/1051] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:15:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:06.748504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d3010-5031-40b5-ae14-ff5a8609285f None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.749114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d3010-5031-40b5-ae14-ff5a8609285f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.749114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d3010-5031-40b5-ae14-ff5a8609285f None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.750661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 519/1052] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:06.755856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:06.756446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:06.756446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:06.781776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:06.783885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:06.919797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 534/1053] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:06.941634 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d3010-5031-40b5-ae14-ff5a8609285f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:06.952875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.066594 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d3010-5031-40b5-ae14-ff5a8609285f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.122986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa87cc57-c8bf-4a81-a9ae-bab8006e6588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.124416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87cc57-c8bf-4a81-a9ae-bab8006e6588 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.124928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87cc57-c8bf-4a81-a9ae-bab8006e6588 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.125439 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa87cc57-c8bf-4a81-a9ae-bab8006e6588 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.149375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa87cc57-c8bf-4a81-a9ae-bab8006e6588 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-aa87cc57-c8bf-4a81-a9ae-bab8006e6588 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:07.161013 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:07.162058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:07.162921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:07.170670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 520/1054] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:07.171978 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.186314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504574fe-99c7-4d3c-ac47-89a948588810 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.186608 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504574fe-99c7-4d3c-ac47-89a948588810 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.186889 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504574fe-99c7-4d3c-ac47-89a948588810 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.188333 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 521/1055] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:07.193767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.194117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.194333 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.213940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:07.215469 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:07.293135 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.293863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.298687 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32606390-c951-40a1-be40-f4f879a316c8 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.301636 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 522/1056] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:07.326490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.360334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.361035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.361317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.361596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.362349 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:07.362660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.364069 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.374039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 535/1057] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:07.379914 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.490908 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ef187d-255f-40d0-9135-86ea6ae7cb81 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.521605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6e7ff-e5a6-4939-80ea-d5670a89df15 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.538700 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.540125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.540640 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.541120 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.558376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.558926 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:07.559246 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.559527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.560360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] PATH_INFO: `/v3/users/2e3140c2af834a7a9b8d8c47ff0a5682` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.574819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] RBAC: Authorizing `identity:get_user(user_id=2e3140c2af834a7a9b8d8c47ff0a5682)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:07.576841 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:07.577805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:15:07.578727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:07.579565 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.579565 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 536/1058] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/users/2e3140c2af834a7a9b8d8c47ff0a5682 => generated 285 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:07.580672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 523/1059] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:07.588966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.589350 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.616130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.663027 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.731711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ca953-4846-42e0-85ee-a10dad328ced None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.735368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a4f45-2b95-4b78-933b-ba83a6f22901 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.779152 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.780029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.780148 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.780462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.781177 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:07.781498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.782876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1270d5-03a3-4148-895d-49ba8278e36c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.783097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.783712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.784015 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.784420 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.797142 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 524/1060] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:07.797437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d116-7308-4168-9ce6-803c9231922e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.797729 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d116-7308-4168-9ce6-803c9231922e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.798006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9356d116-7308-4168-9ce6-803c9231922e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.799471 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 525/1061] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:07.800066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d116-7308-4168-9ce6-803c9231922e None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:07.901784 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.905164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:07.930024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.930607 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9356d116-7308-4168-9ce6-803c9231922e None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:07.955939 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:07.975482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:07.976334 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:07.976609 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:07.976922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:07.987809 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:07.989268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-4a1b77c8-e1b6-44b5-b6c7-eea65de8d83e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:08.006739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:08.007727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:08.008923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:08.008923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:08.008923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:08.008923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:08.008923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 526/1062] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:08.009411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.009673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.009957 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.019271 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 537/1063] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:08.020071 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.030706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:08.032265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:08.116158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 527/1064] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:08.117402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.134577 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728c78d3-aea0-47d4-b6c7-d29e44fde161 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.167101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.191179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.191895 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.192188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.192465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.193222 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:08.193532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.194896 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.207045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 538/1065] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.208706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.224411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.227713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35c1ac-75ed-4200-ba5d-a117b950749e None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.274224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.275624 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.276133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.276588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.278752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] RBAC: Authorizing `identity:get_project(project_id=309d5e45bbb744c5922082cb5159e5f1)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.281669 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.289464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 528/1066] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.289464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.314832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c20a5-1be5-46df-ba42-045f41f9f4e4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.349171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad301516-6deb-4524-9bda-176214609843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.350084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad301516-6deb-4524-9bda-176214609843 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.350376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad301516-6deb-4524-9bda-176214609843 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.350653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad301516-6deb-4524-9bda-176214609843 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.390793 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cc1c17-d798-4b00-a844-7675087df321 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.397247 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.424367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad301516-6deb-4524-9bda-176214609843 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.425723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad301516-6deb-4524-9bda-176214609843 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.429739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.430542 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.430827 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.431102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.438736 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.440224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:08.455139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:08.456228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 529/1067] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:08.457424 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.490266 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.538664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 539/1068] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:08.543682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad301516-6deb-4524-9bda-176214609843 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.568354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f94eb8f-5957-4f4d-9484-fc84896a4f36 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.610473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.611510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.611942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.612401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.613864 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=309d5e45bbb744c5922082cb5159e5f1, user.id=2e3140c2af834a7a9b8d8c47ff0a5682) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:08.614391 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.616867 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.626091 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 530/1069] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/role_assignments?user.id=2e3140c2af834a7a9b8d8c47ff0a5682&scope.project.id=309d5e45bbb744c5922082cb5159e5f1&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.626901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.655611 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.686910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad301516-6deb-4524-9bda-176214609843 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.734194 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.734887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.735171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.735445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.736332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:08.736668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.738130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.760021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 540/1070] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:08.765436 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.766294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.783749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a6539-28df-4f9a-a176-0b3d05cb7dbc None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.827855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.828695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.828997 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.829272 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.842032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.843889 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:08.863969 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:08.865124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:08.866186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:08.866186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:08.866186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:08.866186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:08.866186 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 531/1071] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:08.871149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:08.896426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200de962-6cba-490a-b3c4-1415a0e1179f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:08.941682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:08.942400 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:08.942680 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:08.942951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:08.945996 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:08.964314 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:08.966278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:08.985585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:08.987408 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:08.989101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:08.989101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:08.989101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:08.989101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:08.989101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 541/1072] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:08.993131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.022688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c6dd2-2970-4063-bf8d-e6f951ff5ef7 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.066353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.067022 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.067314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.067592 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.068358 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:09.068667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.070041 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.082777 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 532/1073] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:09.140531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdabc441-e164-42db-aad3-120da15ef17e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.181638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.182339 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.182627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.182906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.183650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:09.183993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.185975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.199493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 542/1074] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:09.205443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.209475 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.324642 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945faff4-c569-4ecf-a6f6-148ddc43f068 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.362528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.363439 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.363842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.364274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.374605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.376795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:09.392708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:09.393693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:09.394602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 533/1075] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:09.399757 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.451375 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.504115 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60ff01e-6d8e-40da-bffd-ac7af63f7d83 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.537922 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.538688 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.538974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.539253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.540084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:09.540402 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.541830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c751ca49-6049-4e97-a18f-4e9e9d426d6f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.554693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 543/1076] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:09.561383 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:09.622023 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:09.659636 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108b8be5-93b3-4955-a486-db37a8b785e8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:09.693767 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb93ec06-bb6f-4409-823f-5d331f17d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:09.694754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ec06-bb6f-4409-823f-5d331f17d3b6 None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:09.695055 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ec06-bb6f-4409-823f-5d331f17d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:09.695315 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb93ec06-bb6f-4409-823f-5d331f17d3b6 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/4f968a9c3d3d4dbfb71216af67cd291e/roles/1d00a3ae7a5f4bc3a418563805def99c` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:09.701978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93ec06-bb6f-4409-823f-5d331f17d3b6 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=4f968a9c3d3d4dbfb71216af67cd291e, role_id=1d00a3ae7a5f4bc3a418563805def99c)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:09.703382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb93ec06-bb6f-4409-823f-5d331f17d3b6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:09.718500 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 534/1077] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:09 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/4f968a9c3d3d4dbfb71216af67cd291e/roles/1d00a3ae7a5f4bc3a418563805def99c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:15:10.804276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af60ad-62fd-47f7-a34f-edcbfbf48e76 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.804843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af60ad-62fd-47f7-a34f-edcbfbf48e76 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.804843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52af60ad-62fd-47f7-a34f-edcbfbf48e76 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.806234 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 544/1078] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:10.813959 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:10.814490 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:10.815018 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:10.839738 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:10.841588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:10.937352 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 535/1079] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:10.959801 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af60ad-62fd-47f7-a34f-edcbfbf48e76 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.066621 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52af60ad-62fd-47f7-a34f-edcbfbf48e76 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.077088 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.105421 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.106193 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.107032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.107360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.117937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:11.125571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:11.126502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:11.127605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 545/1080] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:11.133237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.193084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.246292 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a348f167-c1cc-4bc4-8286-2821dea3b23f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.290912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.291638 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.291945 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.292224 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.292984 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:11.293287 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.295235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.303687 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 536/1081] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:11.309994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.438340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdba221-8b96-4104-bc21-e1f79e8e50af None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.482884 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.483776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.484067 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.484340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] PATH_INFO: `/v3/users/2e3140c2af834a7a9b8d8c47ff0a5682` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.485551 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] RBAC: Authorizing `identity:get_user(user_id=2e3140c2af834a7a9b8d8c47ff0a5682)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.487000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.488946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 546/1082] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/users/2e3140c2af834a7a9b8d8c47ff0a5682 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:11.495074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.601971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec1f5a1-0210-45e2-87f9-a18ccb73a931 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.619426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.639934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d03c20-afad-4406-a175-5076dcdd7fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.640819 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03c20-afad-4406-a175-5076dcdd7fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.641101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03c20-afad-4406-a175-5076dcdd7fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.641379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d03c20-afad-4406-a175-5076dcdd7fb1 None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.642572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d03c20-afad-4406-a175-5076dcdd7fb1 None admin] RBAC: Authorizing `identity:get_project(project_id=309d5e45bbb744c5922082cb5159e5f1)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.644071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d03c20-afad-4406-a175-5076dcdd7fb1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.645818 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 537/1083] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:11 2022] GET /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:11.652435 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:11.695837 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:11.773147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6209d92-4c45-4211-97a7-33823fc71b3d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:11.817497 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5cad93-6a7d-43bd-ba9e-9c0e231d5fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:11.818432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cad93-6a7d-43bd-ba9e-9c0e231d5fc6 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.818718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cad93-6a7d-43bd-ba9e-9c0e231d5fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.819005 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5cad93-6a7d-43bd-ba9e-9c0e231d5fc6 None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1/users/2e3140c2af834a7a9b8d8c47ff0a5682/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.821438 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cad93-6a7d-43bd-ba9e-9c0e231d5fc6 None admin] RBAC: Authorizing `identity:create_grant(project_id=309d5e45bbb744c5922082cb5159e5f1, user_id=2e3140c2af834a7a9b8d8c47ff0a5682, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:11.822902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5cad93-6a7d-43bd-ba9e-9c0e231d5fc6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:11.838458 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 547/1084] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:11 2022] PUT /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1/users/2e3140c2af834a7a9b8d8c47ff0a5682/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:11.864662 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5415b-33fc-4d50-9a52-ff10bdd67c61 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.865255 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5415b-33fc-4d50-9a52-ff10bdd67c61 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.865562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7f5415b-33fc-4d50-9a52-ff10bdd67c61 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.867235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 538/1085] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:11.875130 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:11.875432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:11.875721 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:11.895260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:11.896566 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:11.982004 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 548/1086] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:12.006371 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5415b-33fc-4d50-9a52-ff10bdd67c61 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.122158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7f5415b-33fc-4d50-9a52-ff10bdd67c61 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.163113 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.163982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.164353 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.164544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.177835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:12.185999 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:12.187034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:12.187938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 539/1087] 10.222.0.58 () {56 vars in 1120 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:12.193705 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.221465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.297164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d11fb2-b6f1-40b6-8a82-ae51aa0f0f1a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.332329 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.333291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.333291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.333291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.334045 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:12.334352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.335733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.349086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 549/1088] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:12.350355 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.397458 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.459850 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d15f91-e860-4d8e-a4b1-f29494497435 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.499056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.499871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.500156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.500433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.512090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.514238 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:12.536364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:12.537460 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:12.538450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:12.538450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:12.538450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:12.538450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:12.538450 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 540/1089] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:12.544435 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.635827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.648580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1a138a-bbb5-4bf0-841b-6cf25000c84c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.685849 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.686527 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.686814 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.687094 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.688124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:12.688262 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.689512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.701579 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 550/1090] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:12.707228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:12.809209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:12.816810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4b304e-1bf9-436f-a176-5fddb8eec99b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:12.858261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:12.859066 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:12.859354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:12.859633 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:12.869520 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:12.871002 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:15:12.886647 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:12.888056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:12.889056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 541/1091] 10.222.0.58 () {56 vars in 1093 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:12.893770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.001707 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1856eef2-71b2-4a31-aff7-ba6dbc660ce2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.044001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.044763 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.045058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.045335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.046180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:13.046491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.047959 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.065653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 551/1092] 10.222.0.58 () {56 vars in 1133 bytes} [Fri Jun 17 07:15:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:13.071267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.186993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f20a55e-7f40-46c8-b126-78f8febec719 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.224117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.224762 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.225039 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.225314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.251580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.301412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.302879 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.408670 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 542/1093] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 07:15:13.414547 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.423856 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.536609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e5f4d6-94c2-49a7-a7f3-25585d6cc7d1 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.574012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.575182 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.575531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.575843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.587319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.588803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:13.608040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:13.609218 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:13.610198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:15:13.610198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:13.610198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:15:13.610198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:13.610198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 552/1094] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:13.615084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.685721 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.733656 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c3f3d3-80f0-41ac-8fb7-d0957b4caa4d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.768362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.769030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.769312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.769588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.770312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:13.770623 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.772039 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.784800 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 543/1095] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:13.790197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:13.851695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:13.892632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af205fe7-3d71-47e3-a9e4-1ac39b1137f4 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:13.927132 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:13.927962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:13.928252 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:13.928526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:13.935412 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:13.937132 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-498a0df5-65a2-463b-869b-3d02221e7358 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:15:13.951598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:13.952823 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:13.953743 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 553/1096] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:13.959149 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.029355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15c4a-c838-4303-9596-825827240b87 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.029639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15c4a-c838-4303-9596-825827240b87 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.029911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a15c4a-c838-4303-9596-825827240b87 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.031301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 554/1097] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jun 17 07:15:14.036887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.037173 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.037450 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.056239 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:14.057515 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:14.066036 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636fe220-90f5-4c00-8544-d28af86229f2 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.087278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.105757 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.106975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.107256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.107533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.108346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:14.108653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.110102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.123385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 544/1098] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:15:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:14.129342 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.140334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 555/1099] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:14.166363 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.215371 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.238512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9116603-9dd1-467a-9191-8cba79f0047f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.271345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d43542-de35-40a9-8e7f-734eda72024b None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.277184 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.277842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.278727 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.278922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.279744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] RBAC: Adding query filter params (role.id=1d00a3ae7a5f4bc3a418563805def99c, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=4f968a9c3d3d4dbfb71216af67cd291e) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:14.280078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.281509 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.287311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 545/1100] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/role_assignments?user.id=4f968a9c3d3d4dbfb71216af67cd291e&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=1d00a3ae7a5f4bc3a418563805def99c => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:14.307387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.308400 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.308686 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.308965 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.321887 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:14.329832 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:14.330848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:14.331719 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 556/1101] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:15:14.337600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.385161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.449605 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1462c8-a8ef-4232-a7d8-d3bb7a1a7f21 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.487438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.488076 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.488365 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.488648 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.489397 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:14.489706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.491101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.499880 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 546/1102] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:14.506023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.608927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce74463-a8d4-4098-acc4-d58ac5c3d18e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.618264 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.648162 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.649057 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.649337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.649611 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] PATH_INFO: `/v3/users/2e3140c2af834a7a9b8d8c47ff0a5682` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.650830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] RBAC: Authorizing `identity:get_user(user_id=2e3140c2af834a7a9b8d8c47ff0a5682)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.652642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.654882 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 557/1103] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/users/2e3140c2af834a7a9b8d8c47ff0a5682 => generated 285 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:14.660723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:14.770838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbd02d7-04ed-4209-874f-2c840adc1b14 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:14.772381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:14.808563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:14.809733 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:14.810085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:14.810368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:14.879369 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:14.880870 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:14.982846 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 547/1104] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:14.989158 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.095890 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1fb397-2c54-48dc-81d0-a60b467a2bf0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.131060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608f7d4c-4800-4925-96a7-dd41ecfb5f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.131959 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7d4c-4800-4925-96a7-dd41ecfb5f5e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.132239 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7d4c-4800-4925-96a7-dd41ecfb5f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.132521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608f7d4c-4800-4925-96a7-dd41ecfb5f5e None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.133729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f7d4c-4800-4925-96a7-dd41ecfb5f5e None admin] RBAC: Authorizing `identity:get_project(project_id=309d5e45bbb744c5922082cb5159e5f1)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.135174 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608f7d4c-4800-4925-96a7-dd41ecfb5f5e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.136984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 558/1105] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:14 2022] GET /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:15.143538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:15.145852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:15.251040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baaf499a-0371-4bc1-bd61-375b07d959f8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:15.283720 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:15.284395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:15.284678 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:15.284951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:15.285894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=309d5e45bbb744c5922082cb5159e5f1, user.id=2e3140c2af834a7a9b8d8c47ff0a5682) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:15.286209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:15.287651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45c913e-5978-4b0f-972c-8af4a5b03091 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:15.294137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 548/1106] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:15 2022] GET /identity/v3/role_assignments?user.id=2e3140c2af834a7a9b8d8c47ff0a5682&scope.project.id=309d5e45bbb744c5922082cb5159e5f1&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:17.452891 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c8a7b-0806-4c11-acdc-4fb70670fda6 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:17.453407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c8a7b-0806-4c11-acdc-4fb70670fda6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:17.453407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2c8a7b-0806-4c11-acdc-4fb70670fda6 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:17.454753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 559/1107] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:17.460344 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:17.460768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:17.460909 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:17.478807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:17.480028 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:17.539074 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:17.547411 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 549/1108] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:17.572072 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c8a7b-0806-4c11-acdc-4fb70670fda6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:17.624188 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:17.679179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2c8a7b-0806-4c11-acdc-4fb70670fda6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:17.712868 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5aa735-c5c9-4a1f-a023-93c2a91ce4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:17.713567 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa735-c5c9-4a1f-a023-93c2a91ce4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:17.713844 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa735-c5c9-4a1f-a023-93c2a91ce4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:17.714111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5aa735-c5c9-4a1f-a023-93c2a91ce4c3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:17.715332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa735-c5c9-4a1f-a023-93c2a91ce4c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:17.717310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5aa735-c5c9-4a1f-a023-93c2a91ce4c3 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:17.718946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 560/1109] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:17.724753 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:17.825517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a29529-e19f-4f50-8d11-cef4dbcc91b0 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:17.865153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0aa453-9223-48bb-bb96-f4b5df58081a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:17.865843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa453-9223-48bb-bb96-f4b5df58081a None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:17.866126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa453-9223-48bb-bb96-f4b5df58081a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:17.866402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0aa453-9223-48bb-bb96-f4b5df58081a None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:17.867119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa453-9223-48bb-bb96-f4b5df58081a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:17.868601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0aa453-9223-48bb-bb96-f4b5df58081a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:17.891595 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 550/1110] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:17 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:20.132304 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6e95-3a40-4b27-84a2-fad9cb5b90a6 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.133097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6e95-3a40-4b27-84a2-fad9cb5b90a6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.133097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47a6e95-3a40-4b27-84a2-fad9cb5b90a6 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.134243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 561/1111] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:20.140100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.140584 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.140701 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.158807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:20.160198 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:20.209055 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.241933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 551/1112] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:20.276645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a6e95-3a40-4b27-84a2-fad9cb5b90a6 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.394554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47a6e95-3a40-4b27-84a2-fad9cb5b90a6 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.408647 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.431404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.432387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.432666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.432938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] PATH_INFO: `/v3/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.434938 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] RBAC: Authorizing `identity:get_role(role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.436465 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.438084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 562/1113] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/roles/482894a175b245f6b17bc1592bbbc982 => generated 223 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.443967 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.558068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698494f0-73a1-4588-91f5-a39c164b7c3f None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.599549 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.600457 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.600735 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.601005 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] PATH_INFO: `/v3/users/a0a65341be6f4d31969f85dd2a37b347` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.614851 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] RBAC: Authorizing `identity:get_user(user_id=a0a65341be6f4d31969f85dd2a37b347)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.616355 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.618070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 552/1114] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/users/a0a65341be6f4d31969f85dd2a37b347 => generated 286 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:20.623921 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.732648 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f85587-7d3d-4d85-8c1d-0b3206cb946d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:20.766731 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:20.767379 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:20.767660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:20.767963 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:20.817340 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:20.838231 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:20.839679 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:20.939679 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 563/1115] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:20.946011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:20.991810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.051600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1d97cd-160e-416b-ac33-361bae07ca64 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.086861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6d3280-aa79-441a-86ff-9c87b4c79d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.087817 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3280-aa79-441a-86ff-9c87b4c79d9a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.088214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3280-aa79-441a-86ff-9c87b4c79d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.088535 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6d3280-aa79-441a-86ff-9c87b4c79d9a None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.089799 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d3280-aa79-441a-86ff-9c87b4c79d9a None admin] RBAC: Authorizing `identity:get_project(project_id=309d5e45bbb744c5922082cb5159e5f1)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.091300 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6d3280-aa79-441a-86ff-9c87b4c79d9a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.093158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 553/1116] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:20 2022] GET /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:21.099410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:21.199387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:21.219515 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f530f7-d748-4e79-84d5-75762c133872 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:21.262244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:21.262830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:21.263117 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:21.263394 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:21.264290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] RBAC: Adding query filter params (role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=309d5e45bbb744c5922082cb5159e5f1, user.id=a0a65341be6f4d31969f85dd2a37b347) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:21.264606 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:21.266054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22749ea4-20e6-4f13-bbf5-7c3ca1293d17 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:21.272354 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 564/1117] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:21 2022] GET /identity/v3/role_assignments?user.id=a0a65341be6f4d31969f85dd2a37b347&scope.project.id=309d5e45bbb744c5922082cb5159e5f1&role.id=482894a175b245f6b17bc1592bbbc982 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:23.455184 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934008ea-a828-4983-83d0-f01b3c184d47 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.455693 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934008ea-a828-4983-83d0-f01b3c184d47 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.455823 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934008ea-a828-4983-83d0-f01b3c184d47 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.457222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 554/1118] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:23.462742 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.463179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.463295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.480980 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:23.482167 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:23.548748 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 565/1119] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:23.570986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934008ea-a828-4983-83d0-f01b3c184d47 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.674612 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934008ea-a828-4983-83d0-f01b3c184d47 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.685125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.722740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.723504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.723803 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.724082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] PATH_INFO: `/v3/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.725545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] RBAC: Authorizing `identity:get_role(role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.726921 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.728348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 555/1120] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/roles/482894a175b245f6b17bc1592bbbc982 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:23.734776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.812301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:23.838714 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89edc618-82c5-4daf-a3ad-79622a059819 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:23.873604 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:23.874485 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:23.874773 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:23.875050 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] PATH_INFO: `/v3/users/a0a65341be6f4d31969f85dd2a37b347` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:23.876269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] RBAC: Authorizing `identity:get_user(user_id=a0a65341be6f4d31969f85dd2a37b347)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:23.877693 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:23.879344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 566/1121] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/users/a0a65341be6f4d31969f85dd2a37b347 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:23.885993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:23.996049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8066fab-28b6-4859-8756-9d26ce242ddb None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:24.030156 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3cd7f4-6ec5-4d53-b53f-84d04e98c811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:24.031010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd7f4-6ec5-4d53-b53f-84d04e98c811 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.031278 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd7f4-6ec5-4d53-b53f-84d04e98c811 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.031563 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3cd7f4-6ec5-4d53-b53f-84d04e98c811 None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.032763 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cd7f4-6ec5-4d53-b53f-84d04e98c811 None admin] RBAC: Authorizing `identity:get_project(project_id=309d5e45bbb744c5922082cb5159e5f1)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:24.034202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3cd7f4-6ec5-4d53-b53f-84d04e98c811 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:24.035979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 556/1122] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:23 2022] GET /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:24.042292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:24.145447 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed557d-cfeb-4b6e-9c89-55fe9a11560d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:24.180982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b8bd8-c940-4454-82ae-eed3e699c9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:24.181878 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8bd8-c940-4454-82ae-eed3e699c9e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:24.182158 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8bd8-c940-4454-82ae-eed3e699c9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:24.182432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b8bd8-c940-4454-82ae-eed3e699c9e6 None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1/users/a0a65341be6f4d31969f85dd2a37b347/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:24.184648 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8bd8-c940-4454-82ae-eed3e699c9e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=309d5e45bbb744c5922082cb5159e5f1, user_id=a0a65341be6f4d31969f85dd2a37b347, role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:24.186076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b8bd8-c940-4454-82ae-eed3e699c9e6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:24.199738 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 567/1123] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:24 2022] PUT /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1/users/a0a65341be6f4d31969f85dd2a37b347/roles/482894a175b245f6b17bc1592bbbc982 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:26.381174 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01a884-c2f4-4a64-98c9-988a8421fa9d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.381942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01a884-c2f4-4a64-98c9-988a8421fa9d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.381942 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec01a884-c2f4-4a64-98c9-988a8421fa9d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.383111 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 557/1124] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:26.389117 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.389576 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.389698 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.394653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.408467 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:26.409744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:26.487267 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 568/1125] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:26.511473 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01a884-c2f4-4a64-98c9-988a8421fa9d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.562205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.623195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec01a884-c2f4-4a64-98c9-988a8421fa9d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.661064 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.661845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.662132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.662407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] PATH_INFO: `/v3/roles/482894a175b245f6b17bc1592bbbc982` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.664010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] RBAC: Authorizing `identity:get_role(role_id=482894a175b245f6b17bc1592bbbc982)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:26.665420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:26.666879 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 558/1126] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/roles/482894a175b245f6b17bc1592bbbc982 => generated 223 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:26.673540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.779215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde776d-6e12-485d-935c-ae7ff3bf6dd2 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.813928 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.820931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.821907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.822281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.822665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] PATH_INFO: `/v3/users/a0a65341be6f4d31969f85dd2a37b347` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:26.824038 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] RBAC: Authorizing `identity:get_user(user_id=a0a65341be6f4d31969f85dd2a37b347)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:26.825582 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:26.827257 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 569/1127] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/users/a0a65341be6f4d31969f85dd2a37b347 => generated 286 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:26.834504 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:26.942571 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2547d-7c62-4b93-9df6-8b08cd2566ea None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:26.956137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:26.978334 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:26.978993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:26.979280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:26.979690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.051794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.053284 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.156956 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 559/1128] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:26 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:27.163066 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.275578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47bfd661-7cce-45b7-9f92-a5272b333f4b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.311324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14f8a83-201a-48bd-b180-94b7ae0a258f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.312220 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f8a83-201a-48bd-b180-94b7ae0a258f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.312504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f8a83-201a-48bd-b180-94b7ae0a258f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.312782 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14f8a83-201a-48bd-b180-94b7ae0a258f None admin] PATH_INFO: `/v3/projects/309d5e45bbb744c5922082cb5159e5f1` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.313993 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f8a83-201a-48bd-b180-94b7ae0a258f None admin] RBAC: Authorizing `identity:get_project(project_id=309d5e45bbb744c5922082cb5159e5f1)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.315440 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14f8a83-201a-48bd-b180-94b7ae0a258f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.317196 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 570/1129] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/projects/309d5e45bbb744c5922082cb5159e5f1 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:27.327137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:27.345392 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:27.446906 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8b1c72-39f4-474a-8428-8da2437cb8d1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:27.489604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:27.490268 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:27.490548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:27.490822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:27.491658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] RBAC: Adding query filter params (role.id=482894a175b245f6b17bc1592bbbc982, scope.project.id=309d5e45bbb744c5922082cb5159e5f1, user.id=a0a65341be6f4d31969f85dd2a37b347) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:27.491998 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:27.493590 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aab32aa-95b2-4623-b29c-a98a8a4639a0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:27.503612 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 560/1130] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:27 2022] GET /identity/v3/role_assignments?user.id=a0a65341be6f4d31969f85dd2a37b347&scope.project.id=309d5e45bbb744c5922082cb5159e5f1&role.id=482894a175b245f6b17bc1592bbbc982 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:29.761499 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57938c4-bbab-4e6a-82fc-5e371534a2d3 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.762051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57938c4-bbab-4e6a-82fc-5e371534a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.762303 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57938c4-bbab-4e6a-82fc-5e371534a2d3 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.764288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 571/1131] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:29.770015 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:29.770659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:29.770659 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:29.788837 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:29.790025 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:29.863104 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 561/1132] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:29.888688 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57938c4-bbab-4e6a-82fc-5e371534a2d3 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:29.965717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:30.002967 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57938c4-bbab-4e6a-82fc-5e371534a2d3 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.037243 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a622e62b-2a83-4ee4-b17a-99d7586ccccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.037960 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e62b-2a83-4ee4-b17a-99d7586ccccb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.038245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e62b-2a83-4ee4-b17a-99d7586ccccb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.038523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a622e62b-2a83-4ee4-b17a-99d7586ccccb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.039720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e62b-2a83-4ee4-b17a-99d7586ccccb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.041170 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a622e62b-2a83-4ee4-b17a-99d7586ccccb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.042817 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 572/1133] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:30.048731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:30.063243 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:30.168660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c3805e-607f-4472-8f8b-49cf61226d30 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:30.204361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e5654-cb6a-4e84-9051-cbdd24074bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:30.205035 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5654-cb6a-4e84-9051-cbdd24074bd6 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:30.205317 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5654-cb6a-4e84-9051-cbdd24074bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:30.205591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e5654-cb6a-4e84-9051-cbdd24074bd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:30.206319 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5654-cb6a-4e84-9051-cbdd24074bd6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:30.207783 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e5654-cb6a-4e84-9051-cbdd24074bd6 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:30.235042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 562/1134] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:15:30 2022] POST /identity/v3/projects => generated 311 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:32.457586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f442ea-2ce5-4f1f-b05f-da7f888f1aa9 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.458093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f442ea-2ce5-4f1f-b05f-da7f888f1aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.458093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f442ea-2ce5-4f1f-b05f-da7f888f1aa9 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.459440 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 573/1135] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:32.465291 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.465759 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.465852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.483118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:32.484474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:32.540684 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:32.555068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 563/1136] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:32.579662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f442ea-2ce5-4f1f-b05f-da7f888f1aa9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:32.677490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f442ea-2ce5-4f1f-b05f-da7f888f1aa9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:32.710001 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed16af-ab93-4a2e-b930-ebcb742f63c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:32.710722 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed16af-ab93-4a2e-b930-ebcb742f63c8 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.711007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed16af-ab93-4a2e-b930-ebcb742f63c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.711283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed16af-ab93-4a2e-b930-ebcb742f63c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.712471 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed16af-ab93-4a2e-b930-ebcb742f63c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:32.713894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed16af-ab93-4a2e-b930-ebcb742f63c8 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:32.716179 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 574/1137] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:32.721858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:32.817519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97331a8a-24b8-42bc-9633-328773e33c14 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:32.850132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209a0790-d54f-4824-aa5b-5434b144c201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:32.850794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0790-d54f-4824-aa5b-5434b144c201 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:32.851075 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0790-d54f-4824-aa5b-5434b144c201 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:32.851349 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209a0790-d54f-4824-aa5b-5434b144c201 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:32.852092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0790-d54f-4824-aa5b-5434b144c201 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:32.853527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209a0790-d54f-4824-aa5b-5434b144c201 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:32.874154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 564/1138] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:32 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:15:35.075864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eab87-fb63-44ae-8479-8ae47b89e31d None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.076504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eab87-fb63-44ae-8479-8ae47b89e31d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.076504 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111eab87-fb63-44ae-8479-8ae47b89e31d None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.077770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 575/1139] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:35.082901 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.083286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.083455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.099588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:35.100794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:35.140402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.167848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 565/1140] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:35.191219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eab87-fb63-44ae-8479-8ae47b89e31d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.194958 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.288433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111eab87-fb63-44ae-8479-8ae47b89e31d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.320927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.321702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.321984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.322260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.332477 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:35.339961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:35.341206 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:35.342309 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 576/1141] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:35.347034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.443106 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-291139a3-3a02-44fd-8ee5-f340053cef53 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.475395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.476088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.476378 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.476660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.477402 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:35.477712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.479084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.487463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 566/1142] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.493197 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.554265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.590807 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6188446-8efd-46b5-923e-54b562436a96 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.623082 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.623968 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.624251 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.624525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] PATH_INFO: `/v3/users/54431450e8394dd6b2cc82d79838b70c` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.636910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] RBAC: Authorizing `identity:get_user(user_id=54431450e8394dd6b2cc82d79838b70c)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.638334 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.639984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 577/1143] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/users/54431450e8394dd6b2cc82d79838b70c => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:35.646623 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:35.681428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.746873 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2affb53d-571f-4791-a3ca-469fcf3da652 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:35.780058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:35.780703 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:35.780990 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:35.781269 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:35.848517 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:35.849914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:35.881798 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:35.944686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 567/1144] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:35.950620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.049932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563251b7-d00c-4232-9911-32d9b7350eac None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.071945 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.083526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc65101e-bd16-46c8-a845-a71dfba737b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.084420 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65101e-bd16-46c8-a845-a71dfba737b0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.084706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65101e-bd16-46c8-a845-a71dfba737b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.084985 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc65101e-bd16-46c8-a845-a71dfba737b0 None admin] PATH_INFO: `/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.086157 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65101e-bd16-46c8-a845-a71dfba737b0 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd412be488b4aeaa9bf30c4abc1d90b)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.087586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc65101e-bd16-46c8-a845-a71dfba737b0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.089848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 578/1145] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:35 2022] GET /identity/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:36.095994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:36.191742 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f258835-9035-435c-a6c0-fd84a2f433b4 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:36.224603 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:36.225251 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:36.225532 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:36.225807 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:36.226619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=ffd412be488b4aeaa9bf30c4abc1d90b, user.id=54431450e8394dd6b2cc82d79838b70c) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:36.226928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:36.228388 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069e0772-a1c7-4d81-a854-833c9faf9896 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:36.231152 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:36.234368 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 568/1146] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:36 2022] GET /identity/v3/role_assignments?user.id=54431450e8394dd6b2cc82d79838b70c&scope.project.id=ffd412be488b4aeaa9bf30c4abc1d90b&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.322211 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceb318-9736-445d-ae81-c265dc94a893 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.322728 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceb318-9736-445d-ae81-c265dc94a893 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.322834 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ceb318-9736-445d-ae81-c265dc94a893 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.324168 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 579/1147] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:38.329292 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.329667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.329855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.346551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:38.347730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:38.411934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 569/1148] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:38.434488 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceb318-9736-445d-ae81-c265dc94a893 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.531210 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ceb318-9736-445d-ae81-c265dc94a893 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.563969 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.564744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.565026 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.565299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.575429 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:38.582885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:38.584019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:38.585255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 580/1149] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:38.590706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.684583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332819ab-0252-4b9f-81de-b4e2f134872e None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.711689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.718379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.719041 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.719324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.719601 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.720375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:38.720685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.722059 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.730060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 570/1150] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.735749 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.784329 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:38.832059 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b32b5-a1b9-46b5-9681-5a3659b6fa0e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:38.863138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:38.864013 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:38.864297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:38.864571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] PATH_INFO: `/v3/users/54431450e8394dd6b2cc82d79838b70c` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:38.865732 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] RBAC: Authorizing `identity:get_user(user_id=54431450e8394dd6b2cc82d79838b70c)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:38.867147 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:38.868796 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 581/1151] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/users/54431450e8394dd6b2cc82d79838b70c => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:38.874944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:38.973016 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e6553-b542-4c75-b65d-ed65ff6357ce None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:39.005137 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d7e783-8515-4236-a576-63cca4aadc15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:39.005982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e783-8515-4236-a576-63cca4aadc15 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.006267 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e783-8515-4236-a576-63cca4aadc15 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.006544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d7e783-8515-4236-a576-63cca4aadc15 None admin] PATH_INFO: `/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.007712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e783-8515-4236-a576-63cca4aadc15 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd412be488b4aeaa9bf30c4abc1d90b)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:39.009227 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d7e783-8515-4236-a576-63cca4aadc15 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:39.011661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 571/1152] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:38 2022] GET /identity/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:39.017523 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:39.111841 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a91bf-bc59-4755-b622-593f323f6ae9 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:39.128510 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:39.145760 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc68c68c-26c5-4524-99a0-51837ace54ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:39.146642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c68c-26c5-4524-99a0-51837ace54ec None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:39.146925 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c68c-26c5-4524-99a0-51837ace54ec None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:39.147198 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc68c68c-26c5-4524-99a0-51837ace54ec None admin] PATH_INFO: `/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b/users/54431450e8394dd6b2cc82d79838b70c/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:39.149143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c68c-26c5-4524-99a0-51837ace54ec None admin] RBAC: Authorizing `identity:create_grant(project_id=ffd412be488b4aeaa9bf30c4abc1d90b, user_id=54431450e8394dd6b2cc82d79838b70c, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:39.150570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc68c68c-26c5-4524-99a0-51837ace54ec None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:39.164909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 582/1153] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:39 2022] PUT /identity/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b/users/54431450e8394dd6b2cc82d79838b70c/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:15:41.253291 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972f4e-fb6b-40f2-97db-12dc7efa4ca2 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.253808 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972f4e-fb6b-40f2-97db-12dc7efa4ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.253928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4972f4e-fb6b-40f2-97db-12dc7efa4ca2 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.255236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 572/1154] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:41.260312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.260732 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.260863 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.278261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:41.279656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:41.344816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 583/1155] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:41.368651 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972f4e-fb6b-40f2-97db-12dc7efa4ca2 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.426894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.467089 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4972f4e-fb6b-40f2-97db-12dc7efa4ca2 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.498891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.499680 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.499995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.500274 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.510492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:41.518610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:41.519752 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:41.520852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 573/1156] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:41.525729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.624273 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e41855-949b-4b82-87d1-3e040f589926 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.633279 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.658974 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.659642 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.659959 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.660241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.660984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:41.661293 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:41.662645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:41.670425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 584/1157] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:41.676347 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.772672 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaf2400-3b23-4bc0-a370-572eb9d51b25 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.791809 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:41.807549 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.809069 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.809351 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.809627 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] PATH_INFO: `/v3/users/54431450e8394dd6b2cc82d79838b70c` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.810860 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] RBAC: Authorizing `identity:get_user(user_id=54431450e8394dd6b2cc82d79838b70c)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:41.812354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:41.813998 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 574/1158] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/users/54431450e8394dd6b2cc82d79838b70c => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:41.819881 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:41.918449 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60caa145-bbb4-4b3f-8662-5313614405c2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:41.949839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:41.950479 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:41.950761 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:41.951033 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:41.991259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.018048 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.019487 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.111585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 585/1159] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:42.117307 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.215451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fde8752-c253-4d3a-9f30-bca0241477ef None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.247115 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b5ee80-ebcc-4ea6-969c-23ee5e853ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.247989 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5ee80-ebcc-4ea6-969c-23ee5e853ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.248275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5ee80-ebcc-4ea6-969c-23ee5e853ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.248550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b5ee80-ebcc-4ea6-969c-23ee5e853ea5 None admin] PATH_INFO: `/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.249716 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5ee80-ebcc-4ea6-969c-23ee5e853ea5 None admin] RBAC: Authorizing `identity:get_project(project_id=ffd412be488b4aeaa9bf30c4abc1d90b)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.251150 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b5ee80-ebcc-4ea6-969c-23ee5e853ea5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.252865 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 575/1160] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/projects/ffd412be488b4aeaa9bf30c4abc1d90b => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:42.258868 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:42.323975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:42.353935 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26ddd23-fd26-40c4-97f6-044d5e079853 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:42.385623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:42.386733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:42.387019 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:42.387294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:42.388143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=ffd412be488b4aeaa9bf30c4abc1d90b, user.id=54431450e8394dd6b2cc82d79838b70c) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:42.388456 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:42.389857 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333e9333-261c-4d0d-b33e-04019e41f187 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:42.395549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 586/1161] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:42 2022] GET /identity/v3/role_assignments?user.id=54431450e8394dd6b2cc82d79838b70c&scope.project.id=ffd412be488b4aeaa9bf30c4abc1d90b&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:44.531092 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea147013-3f0d-409a-be39-dd6d9f555a32 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.531587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea147013-3f0d-409a-be39-dd6d9f555a32 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.531587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea147013-3f0d-409a-be39-dd6d9f555a32 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.533056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 576/1162] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:44.538209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.538643 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.538765 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.555552 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:44.556762 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:44.621540 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 587/1163] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:44.643576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea147013-3f0d-409a-be39-dd6d9f555a32 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:44.698875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.742400 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea147013-3f0d-409a-be39-dd6d9f555a32 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:44.774629 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:44.775297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:44.775580 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:44.775885 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:44.840155 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:44.841525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:44.892315 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:44.936741 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 577/1164] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:44.943038 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.001622 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:45.038203 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b99655e-227c-4a3f-a763-d6b0e072a2ba None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.071131 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.071954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.072242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.072519 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.079140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.080776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-50f985d6-085b-4093-822b-1e4dcdc8181b None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:45.095186 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:45.096535 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:15:45.097771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 588/1165] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:15:44 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:45.102379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:45.198754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a078ca-3689-4236-9bcc-da9c48bb2333 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:45.231497 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:45.232334 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:45.232623 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:45.232917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:45.233629 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:45.233936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:45.235298 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f2d158-fda1-4bb6-9755-d74341a6acb4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:45.242314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 578/1166] 10.222.0.58 () {56 vars in 1115 bytes} [Fri Jun 17 07:15:45 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:47.345401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea1e7-e5bb-4e79-a736-28740fec4989 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:47.345923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea1e7-e5bb-4e79-a736-28740fec4989 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:47.346012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8ea1e7-e5bb-4e79-a736-28740fec4989 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:47.347343 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 589/1167] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:47.352606 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96198d8-bd1a-494d-9173-c0f2ff069600 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:47.352992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96198d8-bd1a-494d-9173-c0f2ff069600 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:47.353170 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96198d8-bd1a-494d-9173-c0f2ff069600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:47.369385 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-b96198d8-bd1a-494d-9173-c0f2ff069600 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:47.371072 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-b96198d8-bd1a-494d-9173-c0f2ff069600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:47.385010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:47.437979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 579/1168] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:47.460696 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea1e7-e5bb-4e79-a736-28740fec4989 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:47.558975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8ea1e7-e5bb-4e79-a736-28740fec4989 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:47.582139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:47.593138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9cb469-c7ff-4877-8b45-5592134a84cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:47.593794 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cb469-c7ff-4877-8b45-5592134a84cc None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:47.594077 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cb469-c7ff-4877-8b45-5592134a84cc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:47.594351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9cb469-c7ff-4877-8b45-5592134a84cc None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:47.595098 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cb469-c7ff-4877-8b45-5592134a84cc None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:47.596494 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9cb469-c7ff-4877-8b45-5592134a84cc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:47.611255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 590/1169] 10.222.0.58 () {60 vars in 1138 bytes} [Fri Jun 17 07:15:47 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:49.757327 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fb82-38ba-4551-abaa-e6c120bd226a None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.757891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fb82-38ba-4551-abaa-e6c120bd226a None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.757891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916fb82-38ba-4551-abaa-e6c120bd226a None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.759516 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 580/1170] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:49.765222 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:49.765683 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:49.765778 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:49.783136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:49.784344 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:49.849009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 591/1171] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:15:49.873117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fb82-38ba-4551-abaa-e6c120bd226a None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:49.981853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916fb82-38ba-4551-abaa-e6c120bd226a None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.014303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c3aa0-d21f-4192-9b35-71a266b9ddb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.015085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3aa0-d21f-4192-9b35-71a266b9ddb2 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.015363 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3aa0-d21f-4192-9b35-71a266b9ddb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.015629 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c3aa0-d21f-4192-9b35-71a266b9ddb2 None admin] PATH_INFO: `/v3/domains/491638642b0847338f7562b683ed1779` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.025646 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3aa0-d21f-4192-9b35-71a266b9ddb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=491638642b0847338f7562b683ed1779)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.027979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c3aa0-d21f-4192-9b35-71a266b9ddb2 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.029626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 581/1172] 10.222.0.58 () {56 vars in 1183 bytes} [Fri Jun 17 07:15:49 2022] GET /identity/v3/domains/491638642b0847338f7562b683ed1779 => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:15:50.035453 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:50.132651 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715e4f4a-8ff4-4449-ae9d-5206c2a96014 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:50.147744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:50.170478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8adccf-3f47-4132-82fe-d124e6612ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:50.171145 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8adccf-3f47-4132-82fe-d124e6612ec5 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:50.171428 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8adccf-3f47-4132-82fe-d124e6612ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:50.171700 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8adccf-3f47-4132-82fe-d124e6612ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:50.172446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8adccf-3f47-4132-82fe-d124e6612ec5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:50.173867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8adccf-3f47-4132-82fe-d124e6612ec5 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:50.199905 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 592/1173] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:15:50 2022] POST /identity/v3/projects => generated 361 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:52.378682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065223c-95f3-4768-a019-29520d088c8e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.379235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065223c-95f3-4768-a019-29520d088c8e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.379235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3065223c-95f3-4768-a019-29520d088c8e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.380652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 582/1174] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:52.386414 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.386814 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.386966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.403670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:52.404869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:52.467990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 593/1175] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:52.492097 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065223c-95f3-4768-a019-29520d088c8e None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:52.505212 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:52.591833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3065223c-95f3-4768-a019-29520d088c8e None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:52.624242 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6ef11b-4168-4c09-9c07-370cd86a69f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:52.625103 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ef11b-4168-4c09-9c07-370cd86a69f9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.625386 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ef11b-4168-4c09-9c07-370cd86a69f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.625663 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6ef11b-4168-4c09-9c07-370cd86a69f9 None admin] PATH_INFO: `/v3/domains/491638642b0847338f7562b683ed1779` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.626822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ef11b-4168-4c09-9c07-370cd86a69f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=491638642b0847338f7562b683ed1779)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:52.628287 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c6ef11b-4168-4c09-9c07-370cd86a69f9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:52.629904 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 583/1176] 10.222.0.58 () {56 vars in 1183 bytes} [Fri Jun 17 07:15:52 2022] GET /identity/v3/domains/491638642b0847338f7562b683ed1779 => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:52.635784 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:52.725708 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:52.732906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b428989-12f9-47b5-a565-5186cde24ce8 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:52.767060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049123bf-7960-44d3-a825-991026aead5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:52.767816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049123bf-7960-44d3-a825-991026aead5d None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:52.768102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049123bf-7960-44d3-a825-991026aead5d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:52.768422 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049123bf-7960-44d3-a825-991026aead5d None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:52.769150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049123bf-7960-44d3-a825-991026aead5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:52.770558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049123bf-7960-44d3-a825-991026aead5d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:52.791111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 594/1177] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:15:52 2022] POST /identity/v3/users => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jun 17 07:15:54.974553 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d704ea3-b68e-4c42-81f5-0e51adc24376 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.975086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d704ea3-b68e-4c42-81f5-0e51adc24376 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.975086 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d704ea3-b68e-4c42-81f5-0e51adc24376 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.976514 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 584/1178] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:54.982148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:54.982578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:54.982713 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:54.999558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:55.000768 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:55.063849 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 595/1179] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:55.086721 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d704ea3-b68e-4c42-81f5-0e51adc24376 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.164733 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.187880 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d704ea3-b68e-4c42-81f5-0e51adc24376 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.219840 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.220883 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.221169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.221447 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.232200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:55.239667 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:55.240805 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:55.241834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 585/1180] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:55.247670 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.325511 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.344286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a13dc-148b-4bc3-b89e-ab97e8e624d3 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.377109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.377771 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.378057 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.378336 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.379078 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:55.379386 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.380776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.388923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 596/1181] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.394743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.515079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfc08d-518a-4435-9292-be96576f2d6b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.549600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.550465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.550743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.551014 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] PATH_INFO: `/v3/users/788062223f2845af91d6c7ca8e96ce80` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.558354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.564989 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] RBAC: Authorizing `identity:get_user(user_id=788062223f2845af91d6c7ca8e96ce80)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.566443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.568167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 586/1182] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/users/788062223f2845af91d6c7ca8e96ce80 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:55.574070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.668676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d977b-b262-4c04-8f37-7e56d219475b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:55.700894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:55.701543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:55.701827 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:55.702105 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:55.716607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:55.768961 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:55.770332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:55.868698 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 597/1183] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:15:55.874911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:55.987550 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2bc43-fe46-4eff-89cc-253f97ff726e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.020527 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8095c3-3f14-4116-aeff-176dad50d952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.021316 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8095c3-3f14-4116-aeff-176dad50d952 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.021599 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8095c3-3f14-4116-aeff-176dad50d952 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.021873 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8095c3-3f14-4116-aeff-176dad50d952 None admin] PATH_INFO: `/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.023030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8095c3-3f14-4116-aeff-176dad50d952 None admin] RBAC: Authorizing `identity:get_project(project_id=b1c066df5e4c481a9a5808cbfb32baa2)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.024502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8095c3-3f14-4116-aeff-176dad50d952 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.027042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 587/1184] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:55 2022] GET /identity/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2 => generated 361 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:56.033330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:56.078099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:56.130178 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d469b-7ad8-47a8-93f8-ac887c18bd9b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:56.165358 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:56.166026 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:56.166341 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:56.166617 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:56.167446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=b1c066df5e4c481a9a5808cbfb32baa2, user.id=788062223f2845af91d6c7ca8e96ce80) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:56.167783 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:56.169208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf369bd1-d398-458f-a6a9-ed6b06166fd6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:56.174787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 598/1185] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:15:56 2022] GET /identity/v3/role_assignments?user.id=788062223f2845af91d6c7ca8e96ce80&scope.project.id=b1c066df5e4c481a9a5808cbfb32baa2&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.330419 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852594-6910-4e07-aaa9-53978503da11 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.330938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852594-6910-4e07-aaa9-53978503da11 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.330938 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16852594-6910-4e07-aaa9-53978503da11 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.332390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 588/1186] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:15:58.337546 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.338478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.338615 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.355522 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:15:58.356747 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:15:58.420638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 599/1187] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:15:58.442714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852594-6910-4e07-aaa9-53978503da11 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.504325 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.542090 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16852594-6910-4e07-aaa9-53978503da11 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.574127 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.574900 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.575180 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.575454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.585332 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:15:58.593384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:15:58.594488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:15:58.595561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 589/1188] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:15:58.600839 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.639469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.696180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59516c68-e602-4973-beb2-b4ccb9a205fe None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.728175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.729392 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.729674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.729947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.730682 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:15:58.730986 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.732358 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.740150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 600/1189] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.746428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.841923 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0616be31-9640-4423-9c6d-729e1ce24092 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:58.864242 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.875445 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:58.876655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:58.876655 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:58.876872 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] PATH_INFO: `/v3/users/788062223f2845af91d6c7ca8e96ce80` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:58.878024 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] RBAC: Authorizing `identity:get_user(user_id=788062223f2845af91d6c7ca8e96ce80)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:58.879491 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:58.881123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 590/1190] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/users/788062223f2845af91d6c7ca8e96ce80 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:58.886817 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:58.980298 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:15:58.983317 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9805ff-8dbf-4458-91f7-676af90fc291 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.016739 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3286d29d-3877-4df3-819e-e43dc0ed31f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.017585 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d29d-3877-4df3-819e-e43dc0ed31f2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.017865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d29d-3877-4df3-819e-e43dc0ed31f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.018136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3286d29d-3877-4df3-819e-e43dc0ed31f2 None admin] PATH_INFO: `/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.019290 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d29d-3877-4df3-819e-e43dc0ed31f2 None admin] RBAC: Authorizing `identity:get_project(project_id=b1c066df5e4c481a9a5808cbfb32baa2)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:59.020729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3286d29d-3877-4df3-819e-e43dc0ed31f2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:59.022402 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 601/1191] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:15:58 2022] GET /identity/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:15:59.028604 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:15:59.126299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929097ae-fb00-4582-9799-5a53d688fb80 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:15:59.159650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69da5d4c-a5b8-445e-a2fa-df21ad0d1bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:15:59.160569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5d4c-a5b8-445e-a2fa-df21ad0d1bec None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:15:59.160854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5d4c-a5b8-445e-a2fa-df21ad0d1bec None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:15:59.161129 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69da5d4c-a5b8-445e-a2fa-df21ad0d1bec None admin] PATH_INFO: `/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2/users/788062223f2845af91d6c7ca8e96ce80/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:15:59.163040 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5d4c-a5b8-445e-a2fa-df21ad0d1bec None admin] RBAC: Authorizing `identity:create_grant(project_id=b1c066df5e4c481a9a5808cbfb32baa2, user_id=788062223f2845af91d6c7ca8e96ce80, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:15:59.164512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69da5d4c-a5b8-445e-a2fa-df21ad0d1bec None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:15:59.178303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 591/1192] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:15:59 2022] PUT /identity/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2/users/788062223f2845af91d6c7ca8e96ce80/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:16:01.289136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965256a-b100-41fe-953f-d3841cd91618 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.289675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965256a-b100-41fe-953f-d3841cd91618 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.289675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965256a-b100-41fe-953f-d3841cd91618 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.291627 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 602/1193] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:16:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:16:01.296838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.297232 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.297405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.314310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:16:01.315503 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:16:01.364375 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.385387 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 592/1194] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:16:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:16:01.409460 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965256a-b100-41fe-953f-d3841cd91618 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.511350 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965256a-b100-41fe-953f-d3841cd91618 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.545415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.546208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.546492 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.546767 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.556840 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:16:01.564415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:16:01.565530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:16:01.566716 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 603/1195] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:16:01.571673 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.679986 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d283463-d846-4b31-97fb-9fbe2ce6a1ca None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.714384 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.715065 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.715350 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.715677 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.716389 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:01.716705 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.718101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.726780 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 593/1196] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.733141 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.763291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.844473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39d0959-2537-4573-8b41-acda0d8a5c06 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:01.876849 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:01.877718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:01.878000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:01.878276 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] PATH_INFO: `/v3/users/788062223f2845af91d6c7ca8e96ce80` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:01.879447 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] RBAC: Authorizing `identity:get_user(user_id=788062223f2845af91d6c7ca8e96ce80)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:01.880909 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:01.882549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 604/1197] 10.222.0.58 () {56 vars in 1177 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/users/788062223f2845af91d6c7ca8e96ce80 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:01.888810 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:01.933637 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:01.995722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ad74c-68e0-4fbd-bd00-059b03ecf09d None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.028796 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.029451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.029730 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.030003 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.104454 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.106219 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.155209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.210032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 594/1198] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:16:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:16:02.215805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.311550 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:02.317620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa96d8-1acf-46cc-bcfd-13ff01ff33b0 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.351242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5c459-65bb-44e3-8ab9-9aabf28dc018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.352132 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5c459-65bb-44e3-8ab9-9aabf28dc018 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.352418 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5c459-65bb-44e3-8ab9-9aabf28dc018 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.352698 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5c459-65bb-44e3-8ab9-9aabf28dc018 None admin] PATH_INFO: `/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.353916 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5c459-65bb-44e3-8ab9-9aabf28dc018 None admin] RBAC: Authorizing `identity:get_project(project_id=b1c066df5e4c481a9a5808cbfb32baa2)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.355328 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5c459-65bb-44e3-8ab9-9aabf28dc018 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.357063 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 605/1199] 10.222.0.58 () {56 vars in 1186 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/projects/b1c066df5e4c481a9a5808cbfb32baa2 => generated 361 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:02.363199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:16:02.473367 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-884ff17a-7638-4204-8c57-26106cc8b2e8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:16:02.508093 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:16:02.508749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:16:02.509032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:16:02.509308 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:16:02.510165 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=b1c066df5e4c481a9a5808cbfb32baa2, user.id=788062223f2845af91d6c7ca8e96ce80) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:16:02.510479 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:16:02.511940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c222f-fa54-4beb-b96e-3c41dbe956d0 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:16:02.517743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 595/1200] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:16:02 2022] GET /identity/v3/role_assignments?user.id=788062223f2845af91d6c7ca8e96ce80&scope.project.id=b1c066df5e4c481a9a5808cbfb32baa2&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:16:12.346859 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=18 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:16:12.515233 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=96 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:01.445431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19491b-b5a6-490f-968e-247177fa73c2 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.446027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19491b-b5a6-490f-968e-247177fa73c2 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.446027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f19491b-b5a6-490f-968e-247177fa73c2 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.447316 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 606/1201] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:01.454125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.454671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.454671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.476032 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:01.477396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:01.582713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 596/1202] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:01.614544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19491b-b5a6-490f-968e-247177fa73c2 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.755312 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f19491b-b5a6-490f-968e-247177fa73c2 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:01.795089 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:01.795821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:01.796115 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:01.796549 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:01.808763 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:01.813769 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:01.832153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:01.833215 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:01.834187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:01.834187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:01.834187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:01.834187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:01.834187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 607/1203] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:01.841755 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:01.978983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c76e8c7-9ab6-46c2-9d68-bb2b2cb9a317 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:02.028761 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:02.039249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:02.040061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:02.040364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:02.040722 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:02.041570 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:02.041894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:02.043591 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e53191-7156-408b-adfb-2127841705a7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:02.063992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 597/1204] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:02.071821 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:02.177632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:02.257548 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c016c4aa-5b1c-4d17-bb15-b4c92f16e4e2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:02.332620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0afcc3-ce49-4bfb-acea-77c953381161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:02.333251 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afcc3-ce49-4bfb-acea-77c953381161 None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:02.333541 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afcc3-ce49-4bfb-acea-77c953381161 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:02.333822 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0afcc3-ce49-4bfb-acea-77c953381161 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:02.335155 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0afcc3-ce49-4bfb-acea-77c953381161 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:02.337189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0afcc3-ce49-4bfb-acea-77c953381161 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:02.374480 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 608/1205] 10.222.0.58 () {60 vars in 1132 bytes} [Fri Jun 17 07:17:02 2022] POST /identity/v3/users => generated 251 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:04.950893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7779b-e216-4328-b34a-24c78acf844d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.951993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7779b-e216-4328-b34a-24c78acf844d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.951993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7779b-e216-4328-b34a-24c78acf844d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.953843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 598/1206] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:04.963180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:04.964213 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:04.964403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:04.990425 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:04.992530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:05.094446 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 609/1207] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:05.119381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7779b-e216-4328-b34a-24c78acf844d None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.269924 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7779b-e216-4328-b34a-24c78acf844d None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.311369 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.312209 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.312598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.312839 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.329854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:05.343917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:05.350992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:05.352228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 599/1208] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:05.354862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.400470 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:05.470401 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3d6f2-d176-422a-9bba-6a3b245e579b None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.515373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.516843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.516843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.516843 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.517526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:05.517849 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.519310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.533962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 610/1209] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:05.540330 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.595754 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:05.654301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d10b855-d21f-4008-a8a2-299040154eb9 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.697049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.698021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.698399 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.698768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.711138 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.712744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:05.738049 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:05.744100 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:05.745480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:05.745480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:05.745480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:05.745480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:05.745480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 600/1210] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:05.746103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:05.888474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:05.891947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e51d4-78e1-4739-9c8e-84a0224581ba None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:05.954846 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:05.956142 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:05.956732 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:05.957338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:05.958809 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:05.959410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:05.962018 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:05.984219 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 611/1211] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:05.993983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.137063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2de5e-f260-4a72-943a-9c117719c00b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.140944 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.193077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.194020 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.194312 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.194598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.203131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.204811 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:06.221522 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:06.223596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:06.226026 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 601/1212] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:06.239139 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.384225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbc4e5d-f22e-4c07-ad32-06a6387ccb95 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.420036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.420759 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.421123 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.421545 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.422624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:06.423297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.425971 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.447536 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 612/1213] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:06.453733 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.584857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24e33fe-6ae8-4d0a-ab5a-3698efe6b675 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:06.628324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:06.629233 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:06.629431 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:06.629431 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:06.665750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.720444 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:06.721929 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:06.848775 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 602/1214] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jun 17 07:17:06.855650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:06.881981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:06.986853 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aa5b71-f38a-4f9b-b319-71e15ee005e8 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.026985 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.028008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.028303 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.028580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.042966 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.044512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:07.069326 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:07.071249 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:07.072989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:07.072989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:07.072989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:07.072989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:07.072989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 613/1215] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:07.076530 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.152709 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.200037 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44715af4-a4af-40ab-8a1f-a5cc1cba2011 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.244600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.245281 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.245671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.246031 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.248576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:07.248893 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.250863 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.267121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 603/1216] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:07.274277 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.364208 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.402838 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c244bfa-a899-4ee4-8ce5-12382a0ea3d6 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.442280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.443121 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.443421 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.443720 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.451979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.453497 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:07.472630 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:07.474093 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:07.475657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 614/1217] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:07.481203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.612856 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1343cfb1-e31e-49b7-8d01-1c7644a5990a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.642487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.659857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.661235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.661235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.661235 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.661860 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:07.662214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.664249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd572c-76ba-4cf1-9362-e0b84579c802 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.685881 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 604/1218] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:07.686632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:07.819949 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3160f2fb-1084-48db-9e3f-c1452625caca None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:07.856947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:07.864830 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:07.865566 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:07.865855 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:07.866281 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:07.867120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=9ff0cb6359e94886ba39a06ac3fd1faf) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:07.867528 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:07.869184 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73931d7c-187b-4404-a487-f09cc97d89f0 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:07.879797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 615/1219] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:07 2022] GET /identity/v3/role_assignments?user.id=9ff0cb6359e94886ba39a06ac3fd1faf&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:10.109088 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08be03-f1af-4615-9956-f6b65da92088 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.109632 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08be03-f1af-4615-9956-f6b65da92088 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.109632 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e08be03-f1af-4615-9956-f6b65da92088 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.111133 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 605/1220] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:10.117376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.118118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.118118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.141255 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:10.142606 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:10.222867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 616/1221] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:17:10.246263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08be03-f1af-4615-9956-f6b65da92088 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:10.393546 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e08be03-f1af-4615-9956-f6b65da92088 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:10.453519 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:10.454366 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.454679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.454971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.467778 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:10.475974 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:10.477117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:10.478404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 606/1222] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:17:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:10.483453 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:10.600626 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd27ff9-f438-4919-871f-a8a2f6b03d97 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:10.627325 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:10.640899 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:10.641575 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.641910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.642136 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.642907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] RBAC: Adding query filter params (name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:10.643200 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:10.644671 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:10.654741 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 617/1223] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:17:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:10.661095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:10.712795 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:10.777681 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1dccb2-0115-45ac-ad44-83bd2a2d45dc None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:10.813012 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:10.813842 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:10.814130 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:10.814404 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:10.826132 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:10.827800 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:10.846320 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:10.847474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:10.854057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:10.854057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:10.854057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:10.854057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:10.854057 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 607/1224] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:10.854440 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:10.997171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9deb0839-001b-4097-9ad0-5569107207df None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:11.041165 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:11.041870 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:11.042153 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:11.042434 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:11.043169 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:11.043478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:11.044906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:11.058665 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 618/1225] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:11.064361 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:11.171556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:11.181617 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb303929-96a2-4d6a-83a5-d2a06bd7c10a None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:11.227934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:11.228772 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:11.229063 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:11.229346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:11.237833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:11.239346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:11.257121 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:11.258952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:11.260858 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 608/1226] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:11.264767 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:11.322561 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:11.381912 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2795db43-1168-46fd-b657-57e7c406627a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:11.420879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:11.421710 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:11.421984 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:11.422358 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:11.423345 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:11.423727 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:11.425432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:11.447947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 619/1227] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 17 07:17:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:11.454685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:11.571991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4510033-0d42-4176-a10f-d871e355ad17 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:11.609935 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:11.610746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:11.611029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:11.611306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:11.628311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:11.630048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:11.651533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:11.652760 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:11.654077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:11.654077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:11.654077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:11.654077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:11.654077 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 609/1228] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:11.659161 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:11.773064 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712d5365-cb10-4370-9f71-bdf066b47c65 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:11.775910 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:11.827424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:11.828382 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:11.828699 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:11.829086 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:11.829874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:11.830191 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:11.831726 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:11.846475 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 620/1229] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:11.853061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:11.864753 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:11.988685 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa94f56-1437-4b5c-a2f7-7f9ed65550a5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:12.039587 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:12.040443 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:12.040707 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:12.040985 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:12.049311 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:12.051025 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:12.066834 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:12.068706 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:12.071280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 610/1230] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:12.075798 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:12.202454 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d26cb3-c080-42fa-ad75-3b220f31a7fa None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:12.242113 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:12.242874 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:12.243099 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:12.243400 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:12.244355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:12.244675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:12.246230 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a1ed2-b40d-4f13-80a6-e4dcdc36edc6 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:12.260660 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 621/1231] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:12.267496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:12.355547 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:12.398058 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed217854-94a8-4064-9523-7bcad6463c78 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:12.444348 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c7446-6ab2-495d-afec-962f6e0b1f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:12.445176 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c7446-6ab2-495d-afec-962f6e0b1f0d None admin] REQUEST_METHOD: `PUT` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:12.445538 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c7446-6ab2-495d-afec-962f6e0b1f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:12.445823 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c7446-6ab2-495d-afec-962f6e0b1f0d None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/9ff0cb6359e94886ba39a06ac3fd1faf/roles/a8233058644a4619a9d3f43e87fffcb7` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:12.463203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c7446-6ab2-495d-afec-962f6e0b1f0d None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=9ff0cb6359e94886ba39a06ac3fd1faf, role_id=a8233058644a4619a9d3f43e87fffcb7)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:12.464744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c7446-6ab2-495d-afec-962f6e0b1f0d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:12.479374 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 611/1232] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:12 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/9ff0cb6359e94886ba39a06ac3fd1faf/roles/a8233058644a4619a9d3f43e87fffcb7 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jun 17 07:17:14.890423 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3607d2-d348-444e-98f5-6509c9fc217a None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:14.891046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3607d2-d348-444e-98f5-6509c9fc217a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:14.891046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3607d2-d348-444e-98f5-6509c9fc217a None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:14.892622 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 622/1233] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:14 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:14.900143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:14.900143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:14.900143 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:14.917277 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:14.918780 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:15.001745 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 612/1234] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jun 17 07:17:15.025717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3607d2-d348-444e-98f5-6509c9fc217a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:15.053365 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:15.148389 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3607d2-d348-444e-98f5-6509c9fc217a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:15.189466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:15.190437 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:15.190803 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:15.191124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:15.203596 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:15.212034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:15.213228 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:15.219295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 623/1235] 10.222.0.58 () {56 vars in 1102 bytes} [Fri Jun 17 07:17:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:15.220508 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:15.270379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:15.329940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491f3b7d-d0f4-4fe8-8b77-f3d72ad95b41 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:15.364204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:15.364876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:15.365158 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:15.365432 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:15.366168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] RBAC: Adding query filter params (name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:15.366472 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:15.367866 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:15.376164 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 613/1236] 10.222.0.58 () {56 vars in 1103 bytes} [Fri Jun 17 07:17:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:15.382862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:15.477464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:15.494732 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9760de5a-d8b5-4a46-9fd9-8d141d3ec1fe None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:15.532221 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:15.533023 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:15.533311 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:15.533589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:15.544718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:15.546240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:15.566568 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:15.567879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:15.574489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:15.574489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:15.574489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:15.574489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:15.574489 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 624/1237] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:15.574828 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:15.690002 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737feac-0ce0-4b11-82cb-aae3651e8022 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:15.701095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:15.730396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:15.730994 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:15.731286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:15.731572 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:15.732337 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:15.732649 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:15.734114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:15.746600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 614/1238] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:15.752430 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:15.869047 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb36db-d0de-48e3-82a4-b24a0ca116cc None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:15.907124 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:15.908079 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:15.908431 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:15.908792 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:15.911609 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:15.918567 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:15.920798 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:15.939330 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:15.940638 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:15.941831 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:15.943923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 625/1239] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:15.946523 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.076899 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed995-5570-4e15-9fa5-e564bb31eddf None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:16.136048 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:16.137750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.138346 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.138936 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.140252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:16.140853 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:16.144169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:16.175298 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 615/1240] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 17 07:17:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:16.182466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.323274 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50240142-4394-490a-8a32-0708b53e1144 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:16.370046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:16.370787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.371084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.371364 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.453295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.470703 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:16.472236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:16.616150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 626/1241] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:16 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:16.623202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.656204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.772283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948b2c1c-d874-40c5-91d2-34785c8e7580 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:16.811532 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:16.812382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:16.812666 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:16.812945 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:16.826055 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:16.827686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:16.849440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:16.850983 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:16.852220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:16.852220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:16.852220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:16.852220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:16.852220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 616/1242] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jun 17 07:17:16.857286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:16.978931 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:16.987357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d857efce-e32d-4f64-b00b-e3d41360736b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:17.034905 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:17.035597 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:17.035904 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:17.036180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:17.036935 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:17.037241 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:17.038600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:17.051310 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 627/1243] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:17.059271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:17.195463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:17.223118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a70cf7-8875-4250-8705-84f324b7de07 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:17.264259 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:17.264971 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:17.265254 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:17.265598 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:17.274310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:17.275843 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:17.295562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:17.296765 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:17.297891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 617/1244] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:17.305090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:17.436584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04647005-cc3e-4206-bfed-985f09e752de None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:17.481676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:17.482371 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:17.482655 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:17.482932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:17.483824 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:17.484148 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:17.485599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea720cf0-0c1b-421f-b01d-6052eb234699 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:17.501644 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 628/1245] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:17.508220 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:17.625203 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0276e0f9-6330-4926-8ede-a8fedc7379d5 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:17.670448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:17.671123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:17.671412 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:17.671695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:17.672565 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] RBAC: Adding query filter params (role.id=a8233058644a4619a9d3f43e87fffcb7, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=9ff0cb6359e94886ba39a06ac3fd1faf) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:17.673658 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:17.675205 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae3fa-af8a-4353-9064-ab22db8c0efd None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:17.682482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 618/1246] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:17 2022] GET /identity/v3/role_assignments?user.id=9ff0cb6359e94886ba39a06ac3fd1faf&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=a8233058644a4619a9d3f43e87fffcb7 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:20.351934 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e22b1-b0a0-42c6-8f24-00bffd84a5aa None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:20.352491 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e22b1-b0a0-42c6-8f24-00bffd84a5aa None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:20.352639 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130e22b1-b0a0-42c6-8f24-00bffd84a5aa None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:20.354430 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 629/1247] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:20.361213 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:20.361713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:20.361713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:20.367631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:20.383303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:20.385197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:20.492803 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 619/1248] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:20.517490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e22b1-b0a0-42c6-8f24-00bffd84a5aa None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:20.551337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:20.661478 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130e22b1-b0a0-42c6-8f24-00bffd84a5aa None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:20.700684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:20.701493 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:20.701772 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:20.702044 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:20.713373 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:20.721799 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:20.722907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:20.725263 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 630/1249] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:20.730042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:20.856354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc1c78e-74a6-430c-ba7a-bcabb6ad9c79 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:20.893627 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:20.900764 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:20.901451 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:20.901741 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:20.902078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:20.902910 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:20.903154 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:20.904892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:20.916551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 620/1250] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:20.923416 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:21.021932 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:21.049812 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0f913-aaf8-4c00-b9f8-33eb11357b8b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:21.088766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:21.089935 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:21.090600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:21.090954 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:21.105060 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:21.106684 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:21.128415 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:21.129464 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:21.130525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:21.130525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:21.130525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:21.130525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:21.130525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 631/1251] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:21.136283 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:21.260909 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18240ca5-e66b-4d63-aac6-5dbeca2b53d7 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:21.301734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:21.302483 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:21.302845 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:21.303127 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:21.303898 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:21.304195 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:21.305588 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:21.325544 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 621/1252] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:21.331144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:21.457675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0217b1ca-b6c2-4157-988d-c4c07ddca2bb None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:21.490361 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:21.502525 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:21.503864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:21.504371 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:21.504999 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:21.516996 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:21.518767 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:21.537119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:21.538301 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:21.543201 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 632/1253] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:21 2022] GET /identity/v3/users/placement => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:21.544448 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:21.609551 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:21.659562 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ef7bd9-96cb-4a5e-9f58-9e69151d9365 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:21.704131 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:21.705101 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:21.705390 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:21.705862 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:21.707006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:21.707381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:21.709573 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:21.731098 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 622/1254] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 17 07:17:21 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:21.737645 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:21.860248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecf8479-8f73-4c92-b1b0-5019568aff2e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:21.902149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:21.903054 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:21.903370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:21.903730 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:21.979034 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:22.002387 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.006000 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.165848 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 633/1255] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:21 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:22.167227 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:22.308624 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b33a5d-f3a5-4054-8bf5-9a1a9186374e None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:22.325386 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:22.352381 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:22.353382 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.353696 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.354042 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.365855 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.367428 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:22.385968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:22.387290 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:22.388616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:22.388616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:22.388616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:22.388616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:22.388616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 623/1256] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:22.393678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:22.495119 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:22.522190 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5347f03c-b8d8-42be-9cbb-7dff1ebaa80f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:22.573028 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:22.573620 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.573913 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.574177 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.575360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:22.575797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.577305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.591706 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 634/1257] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:22.597661 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:22.718123 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097f8661-2642-4b6c-97d4-5f7e60f1041f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:22.756244 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:22.757053 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.757345 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.757626 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.766970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.768474 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:22.783463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:22.784512 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:22.785488 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 624/1258] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:22.791259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:22.919101 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa59b56-ebec-4bb0-a1ff-ad310e00d26a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:22.964235 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:22.964981 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:22.965266 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:22.965801 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] PATH_INFO: `/v3/projects` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:22.966808 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:22.967159 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:22.968951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de210fa4-1da3-4ed5-8fbe-625f6bf1bc04 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:22.991435 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 635/1259] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:22.992933 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:23.038297 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:23.136860 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0b061-8aa9-486d-a7f0-79dab78c55a3 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:23.188891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:23.189912 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:23.190403 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:23.191020 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:23.192575 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=9ff0cb6359e94886ba39a06ac3fd1faf) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:23.193676 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:23.196285 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d50f4a-716a-4bee-8954-50f26b931ea4 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:23.207811 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 625/1260] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:22 2022] GET /identity/v3/role_assignments?user.id=9ff0cb6359e94886ba39a06ac3fd1faf&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 259 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:25.366261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25a6d2-b669-43a5-812c-c55d69180b03 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.366826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25a6d2-b669-43a5-812c-c55d69180b03 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.366826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf25a6d2-b669-43a5-812c-c55d69180b03 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.368244 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 636/1261] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:25.373615 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.374039 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.374204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.390756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:25.391980 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:25.459139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 626/1262] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:25.482172 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25a6d2-b669-43a5-812c-c55d69180b03 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:25.492990 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:25.595399 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf25a6d2-b669-43a5-812c-c55d69180b03 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:25.629456 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:25.630294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.630578 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.630850 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.641108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:25.649636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:25.650797 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:25.651865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 637/1263] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:25.657078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:25.675857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:25.754748 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda14d59-f07c-4dbe-b658-8a37c0b3b80c None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:25.792011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:25.792690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.792976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.793243 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] PATH_INFO: `/v3/roles` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.793993 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:25.794299 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:25.795682 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:25.804367 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 627/1264] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:25.810137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:25.876052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:25.910020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc14d04-596a-41f7-89be-18af42658087 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:25.943116 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:25.943946 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:25.944236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:25.944512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:25.956754 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:25.958753 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:25.977175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:25.978351 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:25.979502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:25.979502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:25.979502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:25.979502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:25.979502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 638/1265] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:25.984619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:26.089383 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:26.116147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e8835-d600-4580-a919-89ca7b82f162 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:26.162471 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:26.163173 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:26.163461 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:26.163744 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:26.164510 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:26.164822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:26.166226 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:26.181260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 628/1266] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:26.186877 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:26.288676 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f464761a-ce08-4338-a45d-adfc6748877e None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:26.313626 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:26.328275 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:26.329087 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:26.329372 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:26.329650 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:26.337272 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:26.338709 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:26.353104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:26.354238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:26.355407 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 639/1267] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:26.360124 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:26.460438 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4217130-1eac-4702-9632-74c4a66130e8 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:26.494857 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:26.495528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:26.495836 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:26.496112 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] PATH_INFO: `/v3/users` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:26.496991 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:26.497303 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:26.498740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:26.507631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:26.517943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 629/1268] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 17 07:17:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:26.524114 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:26.633375 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910c8aee-4fe4-40fc-afdc-2b0421177c3a None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:26.666873 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:26.667673 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:26.667989 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:26.668266 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:26.679634 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:26.681116 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:26.705035 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:26.706260 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:26.707483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:26.707483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:26.707483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:26.707483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:26.707483 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 640/1269] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:26.712768 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:26.822569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1ae728-79e8-4315-9efb-c66b7d7fbaae None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:26.857046 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:26.857715 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:26.858002 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:26.858282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:26.859010 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:26.859324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:26.860749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:26.872481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 630/1270] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:26.878318 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:26.914331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:26.987084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dff2ea-2ab4-40ec-b1cd-bf48a0913329 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:27.019473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:27.020292 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:27.021106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:27.021374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:27.028399 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:27.029845 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:27.044717 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:27.045869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:27.047056 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 641/1271] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:27.052011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:27.110106 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:27.152157 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68755350-a33f-437d-9d2c-4c418c7a61a1 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:27.186247 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:27.186828 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:27.187114 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:27.187393 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:27.188204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:27.188521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:27.189968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ee36d2-adaf-425c-bd8f-17420c3cedc9 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:27.202340 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 631/1272] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jun 17 07:17:27.208951 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:27.298391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:27.307410 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0fa643-4f32-47d3-aa5a-e848c00d3e6c None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:27.355129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e3f345-09ea-47e2-9b46-ae524f0e8216 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:27.356623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f345-09ea-47e2-9b46-ae524f0e8216 None admin] REQUEST_METHOD: `PUT` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:27.357107 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f345-09ea-47e2-9b46-ae524f0e8216 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:27.357570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e3f345-09ea-47e2-9b46-ae524f0e8216 None admin] PATH_INFO: `/v3/projects/884ab762591a499b8e10caea0511a886/users/9ff0cb6359e94886ba39a06ac3fd1faf/roles/18d687cc7a4d4771988abb30a2ff1d94` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:27.360770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3f345-09ea-47e2-9b46-ae524f0e8216 None admin] RBAC: Authorizing `identity:create_grant(project_id=884ab762591a499b8e10caea0511a886, user_id=9ff0cb6359e94886ba39a06ac3fd1faf, role_id=18d687cc7a4d4771988abb30a2ff1d94)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:27.363232 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e3f345-09ea-47e2-9b46-ae524f0e8216 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:27.384432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 642/1273] 10.222.0.58 () {58 vars in 1439 bytes} [Fri Jun 17 07:17:27 2022] PUT /identity/v3/projects/884ab762591a499b8e10caea0511a886/users/9ff0cb6359e94886ba39a06ac3fd1faf/roles/18d687cc7a4d4771988abb30a2ff1d94 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jun 17 07:17:29.616911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278d9c-ad38-49e4-a85a-d5ae8303957b None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:29.617489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278d9c-ad38-49e4-a85a-d5ae8303957b None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:29.617489 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc278d9c-ad38-49e4-a85a-d5ae8303957b None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:29.618784 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 632/1274] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:29.624543 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:29.625027 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:29.625132 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:29.644404 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:29.646163 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:29.718151 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 643/1275] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:29.745848 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278d9c-ad38-49e4-a85a-d5ae8303957b None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:29.847493 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc278d9c-ad38-49e4-a85a-d5ae8303957b None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:29.864732 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:29.882482 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:29.883200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:29.883481 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:29.883756 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:29.893618 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(role_id) Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jun 17 07:17:29.901513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:29.902657 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:29.903699 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 633/1276] 10.222.0.58 () {56 vars in 1096 bytes} [Fri Jun 17 07:17:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:29.908776 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:29.996705 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:30.018280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5ee05a-bda1-4e2e-ab92-ad149533aabc None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:30.058269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:30.058950 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:30.059238 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:30.059518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] PATH_INFO: `/v3/roles` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:30.060321 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:30.060635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:30.062002 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:30.070864 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 644/1277] 10.222.0.58 () {56 vars in 1099 bytes} [Fri Jun 17 07:17:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:30.076581 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:30.178792 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f074a606-9f32-41d5-bb13-dfb91ac8948f None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:30.212741 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:30.213540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:30.213828 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:30.214107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:30.225102 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:30.226556 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:30.244021 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:30.245119 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:30.246228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:30.246228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:30.246228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:30.246228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:30.246228 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 634/1278] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:30.251106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:30.352097 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7414aae5-93d0-4048-b048-846c1d02d444 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:30.385342 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:30.386011 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:30.386299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:30.386580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] PATH_INFO: `/v3/domains` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:30.387304 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:30.387615 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:30.389040 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:30.400994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 645/1279] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:30.406686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:30.437952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:30.509405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa07698-4f62-4c7c-8a38-0149664df130 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:30.543634 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:30.544470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:30.544757 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:30.545037 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:30.552616 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:30.554070 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_user(user_id) Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jun 17 07:17:30.568265 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:30.569426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:30.570576 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 635/1280] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:30.575253 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:30.579205 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:30.682679 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4aee845-0e20-4692-941e-3d40fabf003f None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:30.718052 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:30.718654 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:30.718935 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:30.719209 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] PATH_INFO: `/v3/users` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:30.720090 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:30.720403 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:30.721842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:30.740947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 646/1281] 10.222.0.58 () {56 vars in 1143 bytes} [Fri Jun 17 07:17:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:30.746635 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:30.840750 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:30.851379 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704dff9d-8de9-4091-94b6-a1bce911ca34 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:30.884463 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:30.885117 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:30.885401 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:30.885679 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:30.966187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:30.967793 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.059213 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.071678 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 636/1282] 10.222.0.58 () {58 vars in 1282 bytes} [Fri Jun 17 07:17:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jun 17 07:17:31.077635 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.141269 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.184787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8bfc3d-49f4-4b67-ad73-57e1ddf20bb2 None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.229324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.230512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.230937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.231352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.249471 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.252122 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jun 17 07:17:31.286029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:31.287367 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:31.288695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jun 17 07:17:31.288695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jun 17 07:17:31.288695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jun 17 07:17:31.288695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:31.288695 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 647/1283] 10.222.0.58 () {56 vars in 1108 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:31.294301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.397067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef618026-cfed-4f15-8f58-4f497fc23926 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.432440 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.433118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.433406 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.433688 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] PATH_INFO: `/v3/domains` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.434414 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:31.434723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.436141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.448398 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 637/1284] 10.222.0.58 () {56 vars in 1109 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:31.454049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.553674 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb58478-4874-4aef-8cd7-17c1c4941baf None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.568816 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.590012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.590828 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.591109 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.591380 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.599020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.600502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(project_id) Jun 17 07:17:31.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:31.616775 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: ERROR keystone.server.flask.application Jun 17 07:17:31.617729 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 648/1285] 10.222.0.58 () {56 vars in 1111 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:31.623147 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.677461 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:31.731034 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84206dd7-f1ea-4bab-9784-63e7bd497d6b None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.767339 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.768056 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.768347 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.768671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] PATH_INFO: `/v3/projects` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.769476 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:31.769787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.771354 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91b4009-dc36-461f-98a7-08355ebf920d None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.785391 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 638/1286] 10.222.0.58 () {56 vars in 1148 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:31.792380 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:31.910348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233e9e4d-4da2-46fa-b8fc-cd21f727796b None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:31.947532 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:31.948236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:31.948521 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:31.948915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:31.949994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] RBAC: Adding query filter params (role.id=18d687cc7a4d4771988abb30a2ff1d94, scope.project.id=884ab762591a499b8e10caea0511a886, user.id=9ff0cb6359e94886ba39a06ac3fd1faf) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:31.950490 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:31.952331 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88726e8c-3b5b-48d9-92d8-3b63a266b131 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:31.960571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 649/1287] 10.222.0.58 () {56 vars in 1374 bytes} [Fri Jun 17 07:17:31 2022] GET /identity/v3/role_assignments?user.id=9ff0cb6359e94886ba39a06ac3fd1faf&scope.project.id=884ab762591a499b8e10caea0511a886&role.id=18d687cc7a4d4771988abb30a2ff1d94 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:34.172718 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763e94-606c-41d1-ac90-27ecbf254cd5 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.173189 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763e94-606c-41d1-ac90-27ecbf254cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.173289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2763e94-606c-41d1-ac90-27ecbf254cd5 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.174652 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 639/1288] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:34.180558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.180979 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.181110 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.197733 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:34.199046 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:34.230598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:34.293479 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 650/1289] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:34.317078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763e94-606c-41d1-ac90-27ecbf254cd5 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.435690 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2763e94-606c-41d1-ac90-27ecbf254cd5 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.446911 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:34.472455 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.473922 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.474222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.474498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] PATH_INFO: `/v3/services/placement` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.475161 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:34.476583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:34.489237 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:34.490558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:34.491891 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 640/1290] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/services/placement => generated 90 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:34.496636 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.603498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c301b0-5416-4ffb-be94-31e2761fa53a None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.638628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.639302 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.639586 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.639889 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.640605 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] RBAC: Adding query filter params (name=placement) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:34.640911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:34.642265 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0de3b6-4e54-4fc8-abd8-3ff436b754fd None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:34.648214 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 651/1291] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:34.654125 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:34.773275 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbdba98-059b-4b61-8dc7-ffe55e77ffae None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:34.806945 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:34.807619 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:34.807935 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:34.808218 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] PATH_INFO: `/v3/services` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:34.808932 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] RBAC: Adding query filter params (type=placement) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:34.809243 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:34.810631 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4f4c9-25e6-4603-8978-d38de685d7ed None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:34.815314 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 641/1292] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 17 07:17:34 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:36.946133 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69344f-8768-4027-9ad9-0f2cf56b7721 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:36.946675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69344f-8768-4027-9ad9-0f2cf56b7721 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:36.946675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69344f-8768-4027-9ad9-0f2cf56b7721 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:36.948224 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 652/1293] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:36.954335 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfc80-9ec4-4e38-800b-ef02ac0635f7 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:36.954846 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfc80-9ec4-4e38-800b-ef02ac0635f7 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:36.954948 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28cfc80-9ec4-4e38-800b-ef02ac0635f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:36.974886 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-a28cfc80-9ec4-4e38-800b-ef02ac0635f7 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:36.976492 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a28cfc80-9ec4-4e38-800b-ef02ac0635f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:37.019422 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:37.061179 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 642/1294] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:37.083607 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69344f-8768-4027-9ad9-0f2cf56b7721 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:37.115118 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:37.195664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69344f-8768-4027-9ad9-0f2cf56b7721 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:37.234110 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e302ca-6d5e-4b1c-8ac8-9757fd1d13ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:37.234697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e302ca-6d5e-4b1c-8ac8-9757fd1d13ad None admin] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:37.234987 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e302ca-6d5e-4b1c-8ac8-9757fd1d13ad None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:37.235264 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e302ca-6d5e-4b1c-8ac8-9757fd1d13ad None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:37.236030 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e302ca-6d5e-4b1c-8ac8-9757fd1d13ad None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:37.237395 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e302ca-6d5e-4b1c-8ac8-9757fd1d13ad None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:37.252618 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 653/1295] 10.222.0.58 () {60 vars in 1141 bytes} [Fri Jun 17 07:17:37 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:39.452128 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433cc8-51f7-42b7-8dee-f27e84fdb59c None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:39.452660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433cc8-51f7-42b7-8dee-f27e84fdb59c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:39.452660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4433cc8-51f7-42b7-8dee-f27e84fdb59c None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:39.453978 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 643/1296] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:39.459885 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:39.460319 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:39.460435 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:39.476862 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:39.478058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:39.550062 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 654/1297] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:39 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:39.573992 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4433cc8-51f7-42b7-8dee-f27e84fdb59c None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:39.682723 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4433cc8-51f7-42b7-8dee-f27e84fdb59c None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:39.715211 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:39.715970 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:39.716257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:39.716532 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] PATH_INFO: `/v3/services/placement` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:39.717181 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:39.718554 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:39.730118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:39.731395 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:39.732376 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 644/1298] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:17:39 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:39.737433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:39.756915 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:39.835995 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2428ee7e-4750-429d-9147-2f9d361d2dd1 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:39.868617 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:39.869279 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:39.869567 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:39.869841 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:39.870544 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:39.870852 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:39.872236 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:39.877357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 655/1299] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 17 07:17:39 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:39.883892 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:39.917702 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:40.002336 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e8ac90-76c3-4873-bddb-5eada128adeb None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:40.051874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:40.052569 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:40.052861 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:40.053187 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:40.054153 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] RBAC: Adding query filter params (interface=public, service_id=b020171324e34b179bcec9549a90bf0b, region_id=RegionOne) {{(pid=80080) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:40.054416 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:40.055976 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f1c2f2-145e-408a-9f54-e8ad6c3fb34c None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:40.061934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 645/1300] 10.222.0.58 () {56 vars in 1251 bytes} [Fri Jun 17 07:17:39 2022] GET /identity/v3/endpoints?service_id=b020171324e34b179bcec9549a90bf0b&interface=public®ion_id=RegionOne => generated 194 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:40.068021 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:40.162584 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:40.184472 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd78178-7ce8-40ec-bc4b-399049e3248d None admin] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:40.217947 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c570a7f1-6f6e-47b8-bc48-6fee3f7b4678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:40.218617 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a7f1-6f6e-47b8-bc48-6fee3f7b4678 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:40.218902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a7f1-6f6e-47b8-bc48-6fee3f7b4678 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:40.219175 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c570a7f1-6f6e-47b8-bc48-6fee3f7b4678 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:40.219894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570a7f1-6f6e-47b8-bc48-6fee3f7b4678 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:40.221259 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c570a7f1-6f6e-47b8-bc48-6fee3f7b4678 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:40.228786 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 656/1301] 10.222.0.58 () {56 vars in 1087 bytes} [Fri Jun 17 07:17:40 2022] GET /identity/v3/services => generated 2191 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jun 17 07:17:42.340982 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9afa8a-1f34-40b4-9211-c20bed924445 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:42.341537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9afa8a-1f34-40b4-9211-c20bed924445 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:42.341537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9afa8a-1f34-40b4-9211-c20bed924445 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:42.342934 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 646/1302] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:17:42.348906 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:42.349374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:42.349512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:42.366466 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:17:42.367656 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:17:42.433962 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 657/1303] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:17:42 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jun 17 07:17:42.456878 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9afa8a-1f34-40b4-9211-c20bed924445 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:42.551322 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:42.558886 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9afa8a-1f34-40b4-9211-c20bed924445 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:42.593641 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:42.594446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:42.594731 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:42.595006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:42.595665 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:42.597080 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Traceback (most recent call last): Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jun 17 07:17:42.609949 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._get_service(service_id) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jun 17 07:17:42.611236 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.get_or_create( Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application with Lock( Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self._enter() Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application return self.creator() Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application created_value = creator( Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: ERROR keystone.server.flask.application Jun 17 07:17:42.612199 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 647/1304] 10.222.0.58 () {56 vars in 1117 bytes} [Fri Jun 17 07:17:42 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jun 17 07:17:42.617888 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:42.694295 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:42.717245 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212ebdd8-f89c-474e-b3cc-1077f4cf46b9 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:42.752323 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:42.752997 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:42.753287 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:42.753567 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] PATH_INFO: `/v3/services` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:42.754355 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80079) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jun 17 07:17:42.754662 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:42.756050 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fbbe79-595d-4d35-8003-1be3c9ee7e94 None admin] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:42.761252 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 658/1305] 10.222.0.58 () {56 vars in 1116 bytes} [Fri Jun 17 07:17:42 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jun 17 07:17:42.766928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:17:42.874734 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54303b7c-48e0-463a-8357-04e73e266547 None admin] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:17:42.908033 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80db2c6c-e60b-4b31-83eb-557c8fc70724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b8c1c83f1036474f9bd804fc73521ecc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:17:42.908695 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2c6c-e60b-4b31-83eb-557c8fc70724 None admin] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:17:42.908979 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2c6c-e60b-4b31-83eb-557c8fc70724 None admin] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:17:42.909256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80db2c6c-e60b-4b31-83eb-557c8fc70724 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:17:42.910006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2c6c-e60b-4b31-83eb-557c8fc70724 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:17:42.912030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80db2c6c-e60b-4b31-83eb-557c8fc70724 None admin] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:17:42.929883 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 648/1306] 10.222.0.58 () {60 vars in 1144 bytes} [Fri Jun 17 07:17:42 2022] POST /identity/v3/endpoints => generated 331 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jun 17 07:17:52.758469 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=30 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:17:52.926301 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:49.137564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43c83b-07c4-48d1-bf69-b65f99a0ba37 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:49.138020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43c83b-07c4-48d1-bf69-b65f99a0ba37 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:49.138020 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be43c83b-07c4-48d1-bf69-b65f99a0ba37 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:49.139426 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 659/1307] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:18:49.145214 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7165e6-ceb7-4d3a-b27d-0b89bcf6acca None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:49.145621 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7165e6-ceb7-4d3a-b27d-0b89bcf6acca None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:49.146107 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7165e6-ceb7-4d3a-b27d-0b89bcf6acca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:49.278429 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-bf7165e6-ceb7-4d3a-b27d-0b89bcf6acca None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:18:49.279995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-bf7165e6-ceb7-4d3a-b27d-0b89bcf6acca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:49.428583 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 649/1308] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:18:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:18:49.480772 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564c61-7b2d-4342-b43d-af698aa78829 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:49.481360 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564c61-7b2d-4342-b43d-af698aa78829 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:49.481847 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b564c61-7b2d-4342-b43d-af698aa78829 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:49.483896 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 660/1309] 10.222.0.58 () {54 vars in 964 bytes} [Fri Jun 17 07:18:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:18:49.490405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e3a23-3e58-4ec7-9bf8-03f40250b54e None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:49.490689 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e3a23-3e58-4ec7-9bf8-03f40250b54e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:49.490981 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440e3a23-3e58-4ec7-9bf8-03f40250b54e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:49.581072 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-440e3a23-3e58-4ec7-9bf8-03f40250b54e None None] MFA Rules not processed for user `8eca2578e831457bafe0312ca5f875fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:18:49.582210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-440e3a23-3e58-4ec7-9bf8-03f40250b54e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:49.604925 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:49.675629 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b564c61-7b2d-4342-b43d-af698aa78829 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:18:49.677354 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8b564c61-7b2d-4342-b43d-af698aa78829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:49.681660 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 650/1310] 10.222.0.58 () {58 vars in 1061 bytes} [Fri Jun 17 07:18:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:18:49.836623 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b564c61-7b2d-4342-b43d-af698aa78829 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:18:49.926702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:18:49.927526 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:49.927825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:49.928106 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:49.929980 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:49.995907 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:50.066657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:18:50.068225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e039c0-ec86-40e1-8f0f-3f8e35f93b17 service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:18:50.091051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 661/1311] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:18:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:18:52.609852 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a11ce-0c33-4c00-8d3c-f50dcb3d7bbc None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:52.610434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a11ce-0c33-4c00-8d3c-f50dcb3d7bbc None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:52.610434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a11ce-0c33-4c00-8d3c-f50dcb3d7bbc None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:52.611987 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 651/1312] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:18:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:18:52.617029 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762344-602f-4470-9e8f-fad2cdf68fb6 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:52.617456 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762344-602f-4470-9e8f-fad2cdf68fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:52.617774 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31762344-602f-4470-9e8f-fad2cdf68fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:52.707474 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-31762344-602f-4470-9e8f-fad2cdf68fb6 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:18:52.708744 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-31762344-602f-4470-9e8f-fad2cdf68fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:52.808718 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 662/1313] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:18:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:18:52.851558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a11ce-0c33-4c00-8d3c-f50dcb3d7bbc None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:18:52.853118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5f5a11ce-0c33-4c00-8d3c-f50dcb3d7bbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:52.973396 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a11ce-0c33-4c00-8d3c-f50dcb3d7bbc None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:18:53.052287 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:53.055118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:18:53.056011 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:53.056251 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:53.056794 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:53.058874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:53.178208 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:18:53.180252 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0406130-68af-4b65-92a6-b3b51389de09 service neutron] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:18:53.198561 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 652/1314] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:18:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:18:55.729137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc698a09-b082-482a-8e19-d0e19c33c3f1 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:55.729675 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc698a09-b082-482a-8e19-d0e19c33c3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:55.729798 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc698a09-b082-482a-8e19-d0e19c33c3f1 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:55.731091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 663/1315] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:18:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:18:55.736548 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701fea-7edc-427d-8b03-a45e8df0916a None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:55.737004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701fea-7edc-427d-8b03-a45e8df0916a None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:55.737151 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7701fea-7edc-427d-8b03-a45e8df0916a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:55.814400 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-d7701fea-7edc-427d-8b03-a45e8df0916a None None] MFA Rules not processed for user `22548e1724c540eea9f0d7f84af2f81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:18:55.816168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-d7701fea-7edc-427d-8b03-a45e8df0916a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:55.872071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:55.922122 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 653/1316] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:18:55 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:18:55.962937 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc698a09-b082-482a-8e19-d0e19c33c3f1 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:18:55.964531 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-fc698a09-b082-482a-8e19-d0e19c33c3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:55.974252 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:56.077135 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc698a09-b082-482a-8e19-d0e19c33c3f1 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:18:56.158423 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:18:56.159091 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:56.159378 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:56.160092 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:56.161374 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:56.228869 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:56.283327 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:18:56.284810 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aef7d3e-ec1c-4dc2-a569-5a4deb39a9c5 service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:18:56.303624 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 664/1317] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:18:55 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:18:59.002370 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470084-27b2-421f-9906-f33f3ed5e210 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:59.002914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470084-27b2-421f-9906-f33f3ed5e210 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:59.002914 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd470084-27b2-421f-9906-f33f3ed5e210 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:59.004364 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 654/1318] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:18:59.009724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1eca9-35f0-4601-82af-ada58272f7e0 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:59.010150 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1eca9-35f0-4601-82af-ada58272f7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:59.010280 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e1eca9-35f0-4601-82af-ada58272f7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:59.075003 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-b8e1eca9-35f0-4601-82af-ada58272f7e0 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:18:59.076248 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-b8e1eca9-35f0-4601-82af-ada58272f7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:59.176570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 665/1319] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:18:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:18:59.214740 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd470084-27b2-421f-9906-f33f3ed5e210 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:18:59.216344 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-cd470084-27b2-421f-9906-f33f3ed5e210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:59.352168 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd470084-27b2-421f-9906-f33f3ed5e210 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:18:59.436822 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:18:59.438030 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:18:59.438319 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:18:59.438602 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:18:59.440310 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:18:59.447835 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:18:59.548988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:18:59.550435 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e5f920-88c0-4467-a375-b9987182cb57 service neutron] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:18:59.568462 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 655/1320] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:18:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:02.453254 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daafd30-5a49-4bbb-a40b-cb54d6d12eb7 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:02.453766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daafd30-5a49-4bbb-a40b-cb54d6d12eb7 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:02.453766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daafd30-5a49-4bbb-a40b-cb54d6d12eb7 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:02.455112 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 666/1321] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:02.460586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d757-b5df-41a5-9c20-87f22196779e None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:02.461095 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d757-b5df-41a5-9c20-87f22196779e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:02.461204 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5525d757-b5df-41a5-9c20-87f22196779e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:02.534871 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-5525d757-b5df-41a5-9c20-87f22196779e None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:02.536179 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-5525d757-b5df-41a5-9c20-87f22196779e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:02.605407 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:02.653525 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 656/1322] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:02.690666 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daafd30-5a49-4bbb-a40b-cb54d6d12eb7 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:02.692376 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8daafd30-5a49-4bbb-a40b-cb54d6d12eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:02.713440 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:02.810985 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daafd30-5a49-4bbb-a40b-cb54d6d12eb7 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:02.899787 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:02.900454 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:02.900734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:02.901006 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:02.902646 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:02.979390 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:03.019181 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:03.021102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5b8e29-f3f3-4ca0-8c0e-cc3fece4ee79 service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:03.040626 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 667/1323] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:05.245085 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0319-c9e4-4158-9b51-1c21c8faab1f None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:05.245610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0319-c9e4-4158-9b51-1c21c8faab1f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:05.245610 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0319-c9e4-4158-9b51-1c21c8faab1f None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:05.247004 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 657/1324] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:05.252278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4447-8210-47d1-a467-060747e25b34 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:05.252681 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4447-8210-47d1-a467-060747e25b34 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:05.252835 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12d4447-8210-47d1-a467-060747e25b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:05.316833 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-e12d4447-8210-47d1-a467-060747e25b34 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:05.318051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-e12d4447-8210-47d1-a467-060747e25b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:05.425051 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 668/1325] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:05.474809 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d221-3783-4ae6-a3fb-04f436a4dd3a None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:05.475071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d221-3783-4ae6-a3fb-04f436a4dd3a None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:05.475343 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490d221-3783-4ae6-a3fb-04f436a4dd3a None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:05.476774 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 658/1326] 10.222.0.58 () {54 vars in 964 bytes} [Fri Jun 17 07:19:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:05.484189 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078220-1f8a-495c-87ef-d96ee713e24d None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:05.484558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078220-1f8a-495c-87ef-d96ee713e24d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:05.484842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2078220-1f8a-495c-87ef-d96ee713e24d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:05.516284 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:05.568570 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-f2078220-1f8a-495c-87ef-d96ee713e24d None None] MFA Rules not processed for user `8eca2578e831457bafe0312ca5f875fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:05.569975 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-f2078220-1f8a-495c-87ef-d96ee713e24d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:05.655412 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 669/1327] 10.222.0.58 () {58 vars in 1061 bytes} [Fri Jun 17 07:19:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:05.664708 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490d221-3783-4ae6-a3fb-04f436a4dd3a None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:05.666270 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-8490d221-3783-4ae6-a3fb-04f436a4dd3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:05.788692 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490d221-3783-4ae6-a3fb-04f436a4dd3a None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:05.862535 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:05.863197 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:05.863485 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:05.863821 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:05.865480 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:05.882600 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:05.978326 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:05.979714 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb544032-d858-4255-99ab-bb15240fb1b0 service neutron] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:05.998256 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 659/1328] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:08.465782 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dce1de-4b04-4fb1-ac11-723ebbf39c8d None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:08.466299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dce1de-4b04-4fb1-ac11-723ebbf39c8d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:08.466479 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06dce1de-4b04-4fb1-ac11-723ebbf39c8d None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:08.468592 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 670/1329] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:08.474263 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94223d3-aec0-4f0e-b4c4-8d8d46e66d1f None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:08.474715 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94223d3-aec0-4f0e-b4c4-8d8d46e66d1f None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:08.474833 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94223d3-aec0-4f0e-b4c4-8d8d46e66d1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:08.547487 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-e94223d3-aec0-4f0e-b4c4-8d8d46e66d1f None None] MFA Rules not processed for user `22548e1724c540eea9f0d7f84af2f81e`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:08.548743 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-e94223d3-aec0-4f0e-b4c4-8d8d46e66d1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:08.622110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:08.656656 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 660/1330] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:08 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:08.694308 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dce1de-4b04-4fb1-ac11-723ebbf39c8d None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:08.695894 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-06dce1de-4b04-4fb1-ac11-723ebbf39c8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:08.816898 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06dce1de-4b04-4fb1-ac11-723ebbf39c8d None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:08.840058 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:08.897332 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:08.898003 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:08.898291 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:08.898567 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:08.900297 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:09.027288 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:09.029386 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a78e1a-be45-492f-99fc-3e24efced312 service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:09.053865 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 671/1331] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:08 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:11.536534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9e0c-1207-4c57-89ca-0bec55ba1c0b None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.537079 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9e0c-1207-4c57-89ca-0bec55ba1c0b None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.537175 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f9e0c-1207-4c57-89ca-0bec55ba1c0b None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.539470 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 661/1332] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:11.545072 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87437c7b-bb67-41ad-be06-a68c39086034 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.545653 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87437c7b-bb67-41ad-be06-a68c39086034 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.546275 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87437c7b-bb67-41ad-be06-a68c39086034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.612798 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:11.616837 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-87437c7b-bb67-41ad-be06-a68c39086034 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:11.618308 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-87437c7b-bb67-41ad-be06-a68c39086034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:11.719049 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 672/1333] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:11.755593 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9e0c-1207-4c57-89ca-0bec55ba1c0b None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:11.757167 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-a37f9e0c-1207-4c57-89ca-0bec55ba1c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:11.865405 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37f9e0c-1207-4c57-89ca-0bec55ba1c0b None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:11.941029 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:11.941686 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:11.941968 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:11.942239 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:11.944072 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:11.978875 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:12.065952 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:12.067675 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550d7733-f3e1-4f6e-9f48-c7497c5a7540 service neutron] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:12.087282 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 662/1334] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:14.306192 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d776d-02a2-4c80-b2ae-5692a6cee495 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.306762 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d776d-02a2-4c80-b2ae-5692a6cee495 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.306762 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595d776d-02a2-4c80-b2ae-5692a6cee495 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.308204 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 673/1335] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:14.314749 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eeb88-3228-47c4-86a8-2c188225769c None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.315324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eeb88-3228-47c4-86a8-2c188225769c None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.315324 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1eeb88-3228-47c4-86a8-2c188225769c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.387928 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-7c1eeb88-3228-47c4-86a8-2c188225769c None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:14.389169 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-7c1eeb88-3228-47c4-86a8-2c188225769c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:14.470650 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:14.493950 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 663/1336] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:14.534183 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d776d-02a2-4c80-b2ae-5692a6cee495 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:14.535723 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-595d776d-02a2-4c80-b2ae-5692a6cee495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:14.647137 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595d776d-02a2-4c80-b2ae-5692a6cee495 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:14.676268 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:14.720324 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:14.721055 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:14.721286 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:14.721564 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:14.723223 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:14.835084 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:14.836539 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8f99d6-2ea5-47eb-b281-12081d7a197d service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:14.855009 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 674/1337] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:17.346654 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3413-a106-4588-a976-1e4a57631f93 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:17.347104 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3413-a106-4588-a976-1e4a57631f93 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:17.347210 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3413-a106-4588-a976-1e4a57631f93 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:17.348597 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 664/1338] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:17.353766 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e75a-271e-4527-bbef-6f7c4fb1fa59 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:17.354187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e75a-271e-4527-bbef-6f7c4fb1fa59 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:17.354338 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4e75a-271e-4527-bbef-6f7c4fb1fa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:17.424920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-a9b4e75a-271e-4527-bbef-6f7c4fb1fa59 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:17.424920 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-a9b4e75a-271e-4527-bbef-6f7c4fb1fa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:17.430120 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:17.520397 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 675/1339] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:17 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:17.557996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3413-a106-4588-a976-1e4a57631f93 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:17.557996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-cbfd3413-a106-4588-a976-1e4a57631f93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:17.664194 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3413-a106-4588-a976-1e4a57631f93 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:17.739846 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:17.740427 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:17.740712 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:17.740988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:17.742653 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:17.779439 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:17.852966 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:17.854420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc230e79-6e3e-46b3-871c-3d690f8b3eaa service neutron] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:17.881446 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 665/1340] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:17 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:22.038008 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8919-70de-4bd9-8c14-b5d9286f7ee4 None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:22.038701 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8919-70de-4bd9-8c14-b5d9286f7ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:22.038994 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baee8919-70de-4bd9-8c14-b5d9286f7ee4 None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:22.040442 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 676/1341] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:22.046596 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b681af2-73d0-496e-8f95-43be3bb8729d None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:22.047110 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b681af2-73d0-496e-8f95-43be3bb8729d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:22.047225 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b681af2-73d0-496e-8f95-43be3bb8729d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:22.130221 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-9b681af2-73d0-496e-8f95-43be3bb8729d None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:22.131437 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-9b681af2-73d0-496e-8f95-43be3bb8729d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:22.230917 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=100 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:22.246540 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 666/1342] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:22.289724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8919-70de-4bd9-8c14-b5d9286f7ee4 None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:22.291936 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-baee8919-70de-4bd9-8c14-b5d9286f7ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:22.387746 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baee8919-70de-4bd9-8c14-b5d9286f7ee4 None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:22.391902 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0119cc96-7a12-45b6-b5f4-98cb737eb4a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:22.392557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119cc96-7a12-45b6-b5f4-98cb737eb4a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:22.392833 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119cc96-7a12-45b6-b5f4-98cb737eb4a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:22.393104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0119cc96-7a12-45b6-b5f4-98cb737eb4a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:22.402734 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119cc96-7a12-45b6-b5f4-98cb737eb4a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:22.404203 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0119cc96-7a12-45b6-b5f4-98cb737eb4a6 service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:22.414352 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 677/1343] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:25.620959 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880a630-b751-486b-8e55-b5cbeb241cd6 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:25.621502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880a630-b751-486b-8e55-b5cbeb241cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:25.621502 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b880a630-b751-486b-8e55-b5cbeb241cd6 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:25.622951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 667/1344] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:25.628551 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ee69-68d5-4e42-af72-658cc007766f None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:25.629032 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ee69-68d5-4e42-af72-658cc007766f None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:25.629144 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c9ee69-68d5-4e42-af72-658cc007766f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:25.660111 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-e2c9ee69-68d5-4e42-af72-658cc007766f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:25.661370 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-e2c9ee69-68d5-4e42-af72-658cc007766f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:25.691133 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:25.741278 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 678/1345] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:25 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:25.780458 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880a630-b751-486b-8e55-b5cbeb241cd6 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:25.791629 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b880a630-b751-486b-8e55-b5cbeb241cd6 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:25.795126 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb372de-d1c1-4a02-b3a2-b3ea808056f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:25.795797 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb372de-d1c1-4a02-b3a2-b3ea808056f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:25.796082 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb372de-d1c1-4a02-b3a2-b3ea808056f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:25.796360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb372de-d1c1-4a02-b3a2-b3ea808056f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:25.805876 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb372de-d1c1-4a02-b3a2-b3ea808056f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:25.807425 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb372de-d1c1-4a02-b3a2-b3ea808056f7 service neutron] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:25.817947 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 668/1346] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:30.369143 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb07a5-c56e-4493-807b-90513e62bd1f None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:30.369668 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb07a5-c56e-4493-807b-90513e62bd1f None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:30.369786 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcb07a5-c56e-4493-807b-90513e62bd1f None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:30.371085 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 679/1347] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:30.376634 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb2f8-7923-4137-9b2f-1d28ee5cf275 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:30.377084 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb2f8-7923-4137-9b2f-1d28ee5cf275 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:30.377175 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cb2f8-7923-4137-9b2f-1d28ee5cf275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:30.396037 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c35cb2f8-7923-4137-9b2f-1d28ee5cf275 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:30.397249 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c35cb2f8-7923-4137-9b2f-1d28ee5cf275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:30.405975 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 669/1348] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:30.445424 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb07a5-c56e-4493-807b-90513e62bd1f None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:30.456770 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcb07a5-c56e-4493-807b-90513e62bd1f None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:30.460442 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6605859-4e8e-4eab-a32a-232a3acd7c29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '8eca2578e831457bafe0312ca5f875fe', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:30.461102 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6605859-4e8e-4eab-a32a-232a3acd7c29 service neutron] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:30.461381 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6605859-4e8e-4eab-a32a-232a3acd7c29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:30.461657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6605859-4e8e-4eab-a32a-232a3acd7c29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:30.472242 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6605859-4e8e-4eab-a32a-232a3acd7c29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:30.473790 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6605859-4e8e-4eab-a32a-232a3acd7c29 service neutron] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:30.486417 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 680/1349] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:35.605188 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabb54e-ba17-4141-849b-f81b5481f22d None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:35.606080 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabb54e-ba17-4141-849b-f81b5481f22d None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:35.606585 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eabb54e-ba17-4141-849b-f81b5481f22d None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:35.610202 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 670/1350] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 17 07:19:35 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:35.615580 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb753ae-5484-4265-baac-ac24b1a8b404 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:35.616140 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb753ae-5484-4265-baac-ac24b1a8b404 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:35.616225 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb753ae-5484-4265-baac-ac24b1a8b404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:35.715982 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-ebb753ae-5484-4265-baac-ac24b1a8b404 None None] MFA Rules not processed for user `9ff0cb6359e94886ba39a06ac3fd1faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:35.717149 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-ebb753ae-5484-4265-baac-ac24b1a8b404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:35.850473 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 681/1351] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 17 07:19:35 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:40.390545 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=13 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:40.430289 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7dd1-333e-4aed-9a89-fbe23eb02d82 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:40.430478 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7dd1-333e-4aed-9a89-fbe23eb02d82 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:40.430786 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f7dd1-333e-4aed-9a89-fbe23eb02d82 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:40.432534 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 671/1352] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 17 07:19:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:40.439055 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad7e79-221c-4f18-8ef8-262c445f7d0e None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:40.440261 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad7e79-221c-4f18-8ef8-262c445f7d0e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:40.440826 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad7e79-221c-4f18-8ef8-262c445f7d0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:40.465433 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-3fad7e79-221c-4f18-8ef8-262c445f7d0e None None] MFA Rules not processed for user `9ff0cb6359e94886ba39a06ac3fd1faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:40.467172 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-3fad7e79-221c-4f18-8ef8-262c445f7d0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:40.477600 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 682/1353] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 17 07:19:40 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:41.991078 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449570-bd58-4dbb-a36a-189fcf3c72d9 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:41.991634 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449570-bd58-4dbb-a36a-189fcf3c72d9 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:41.991634 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37449570-bd58-4dbb-a36a-189fcf3c72d9 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:41.993060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 672/1354] 10.222.0.58 () {54 vars in 921 bytes} [Fri Jun 17 07:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:41.998805 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7ce8-f884-43c0-acc0-f445a28fa5f5 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:41.999445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7ce8-f884-43c0-acc0-f445a28fa5f5 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:41.999445 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7ce8-f884-43c0-acc0-f445a28fa5f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:42.020103 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-6a4e7ce8-f884-43c0-acc0-f445a28fa5f5 None None] MFA Rules not processed for user `9ff0cb6359e94886ba39a06ac3fd1faf`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:42.021554 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-6a4e7ce8-f884-43c0-acc0-f445a28fa5f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:42.030872 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 683/1355] 10.222.0.58 () {58 vars in 1018 bytes} [Fri Jun 17 07:19:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:45.793229 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3273-0173-4970-b397-9075c67c3686 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:45.794261 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3273-0173-4970-b397-9075c67c3686 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:45.794586 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e3273-0173-4970-b397-9075c67c3686 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:45.796260 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 673/1356] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:45.802108 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004559-9a39-4573-8e71-33d6d268418c None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:45.802608 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004559-9a39-4573-8e71-33d6d268418c None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:45.802712 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74004559-9a39-4573-8e71-33d6d268418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:45.820941 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-74004559-9a39-4573-8e71-33d6d268418c None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:45.822138 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-74004559-9a39-4573-8e71-33d6d268418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:45.830860 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 684/1357] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:19:45.890067 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a419557-5e80-4184-97db-45a963e8ec6e None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:45.890362 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a419557-5e80-4184-97db-45a963e8ec6e None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:45.890644 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a419557-5e80-4184-97db-45a963e8ec6e None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:45.892068 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 674/1358] 10.222.0.58 () {54 vars in 961 bytes} [Fri Jun 17 07:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:45.912972 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d5de-2ad9-41e3-bbc2-25ae55a2cc10 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:45.913590 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d5de-2ad9-41e3-bbc2-25ae55a2cc10 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:45.914053 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f90d5de-2ad9-41e3-bbc2-25ae55a2cc10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:45.970216 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:45.979587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-8f90d5de-2ad9-41e3-bbc2-25ae55a2cc10 None None] MFA Rules not processed for user `4f968a9c3d3d4dbfb71216af67cd291e`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:45.981171 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-8f90d5de-2ad9-41e3-bbc2-25ae55a2cc10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:46.082240 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 685/1359] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Jun 17 07:19:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:19:46.083493 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a419557-5e80-4184-97db-45a963e8ec6e None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:46.099813 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a419557-5e80-4184-97db-45a963e8ec6e None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:46.106089 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4abedc-5c82-4ee3-bdca-74299e15f421 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:46.106773 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abedc-5c82-4ee3-bdca-74299e15f421 service nova] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:46.107061 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abedc-5c82-4ee3-bdca-74299e15f421 service nova] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:46.107513 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abedc-5c82-4ee3-bdca-74299e15f421 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:46.116537 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4abedc-5c82-4ee3-bdca-74299e15f421 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:46.118182 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4abedc-5c82-4ee3-bdca-74299e15f421 service nova] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:46.129006 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 675/1360] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:48.494825 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605459-e641-4437-81e0-12ff4e5093ed None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:48.497180 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605459-e641-4437-81e0-12ff4e5093ed None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:48.498012 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10605459-e641-4437-81e0-12ff4e5093ed None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:48.499432 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 686/1361] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:48.505284 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac139ad-0b95-4a26-a7ad-230bd55cc7d9 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:48.505802 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac139ad-0b95-4a26-a7ad-230bd55cc7d9 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:48.505802 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac139ad-0b95-4a26-a7ad-230bd55cc7d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:48.524889 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-aac139ad-0b95-4a26-a7ad-230bd55cc7d9 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:48.526106 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-aac139ad-0b95-4a26-a7ad-230bd55cc7d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:48.534898 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 676/1362] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:48.579558 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10605459-e641-4437-81e0-12ff4e5093ed None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:48.596867 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10605459-e641-4437-81e0-12ff4e5093ed None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:48.603294 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca09ef-551c-4906-a845-870102eb3e88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:48.603911 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca09ef-551c-4906-a845-870102eb3e88 service nova] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:48.604199 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca09ef-551c-4906-a845-870102eb3e88 service nova] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:48.604702 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca09ef-551c-4906-a845-870102eb3e88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:48.617400 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca09ef-551c-4906-a845-870102eb3e88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:48.619589 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfca09ef-551c-4906-a845-870102eb3e88 service nova] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:48.635348 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 687/1363] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:51.189392 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02159-4bf4-41fd-b362-a2dce4e45320 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:51.189943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02159-4bf4-41fd-b362-a2dce4e45320 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:51.189943 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02159-4bf4-41fd-b362-a2dce4e45320 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:51.191306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 677/1364] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:51.197070 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebad6f-7c26-4611-af7b-0fcc084facfb None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:51.197530 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebad6f-7c26-4611-af7b-0fcc084facfb None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:51.197632 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ebad6f-7c26-4611-af7b-0fcc084facfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:51.216522 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-c9ebad6f-7c26-4611-af7b-0fcc084facfb None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:51.217713 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-c9ebad6f-7c26-4611-af7b-0fcc084facfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:51.229763 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 688/1365] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:51.291533 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677676f7-1997-48c5-8258-405420c3d361 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:51.291988 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677676f7-1997-48c5-8258-405420c3d361 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:51.292352 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677676f7-1997-48c5-8258-405420c3d361 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:51.293739 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 678/1366] 10.222.0.58 () {54 vars in 961 bytes} [Fri Jun 17 07:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:51.299305 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7842c5-a410-4168-b7c2-d41d637e284d None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:51.299599 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7842c5-a410-4168-b7c2-d41d637e284d None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:51.299923 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7842c5-a410-4168-b7c2-d41d637e284d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:51.319998 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-4c7842c5-a410-4168-b7c2-d41d637e284d None None] MFA Rules not processed for user `4f968a9c3d3d4dbfb71216af67cd291e`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:51.321184 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-4c7842c5-a410-4168-b7c2-d41d637e284d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:51.331628 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 689/1367] 10.222.0.58 () {58 vars in 1058 bytes} [Fri Jun 17 07:19:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:51.340995 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677676f7-1997-48c5-8258-405420c3d361 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:51.359118 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677676f7-1997-48c5-8258-405420c3d361 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:51.365787 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faef1fcd-93a6-4245-9242-4ff0eb71891b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:51.367258 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1fcd-93a6-4245-9242-4ff0eb71891b service nova] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:51.367464 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1fcd-93a6-4245-9242-4ff0eb71891b service nova] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:51.367640 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faef1fcd-93a6-4245-9242-4ff0eb71891b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:51.380558 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1fcd-93a6-4245-9242-4ff0eb71891b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:51.382359 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faef1fcd-93a6-4245-9242-4ff0eb71891b service nova] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:51.396697 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 679/1368] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:53.762587 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbe666-555a-4896-8134-8904722e24fc None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:53.764187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbe666-555a-4896-8134-8904722e24fc None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:53.764187 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fbe666-555a-4896-8134-8904722e24fc None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:53.765299 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 690/1369] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:53.770854 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07987a4-f947-4edd-aab9-67720f2bf345 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:53.771306 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07987a4-f947-4edd-aab9-67720f2bf345 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:53.771423 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07987a4-f947-4edd-aab9-67720f2bf345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:53.791838 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-c07987a4-f947-4edd-aab9-67720f2bf345 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:53.793060 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-c07987a4-f947-4edd-aab9-67720f2bf345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:53.810116 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 680/1370] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:19:53.856212 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbe666-555a-4896-8134-8904722e24fc None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:53.876829 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fbe666-555a-4896-8134-8904722e24fc None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:53.883202 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbe81e0-6348-404e-b1d6-ff28c4a311d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:53.884125 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe81e0-6348-404e-b1d6-ff28c4a311d5 service nova] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:53.884571 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe81e0-6348-404e-b1d6-ff28c4a311d5 service nova] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:53.885024 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbe81e0-6348-404e-b1d6-ff28c4a311d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:53.895637 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe81e0-6348-404e-b1d6-ff28c4a311d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:53.897724 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbe81e0-6348-404e-b1d6-ff28c4a311d5 service nova] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:53.920036 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 691/1371] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:54.265257 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4749d17-20a5-417b-960f-5f937016c405 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:54.265542 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4749d17-20a5-417b-960f-5f937016c405 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:54.266024 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4749d17-20a5-417b-960f-5f937016c405 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:54.267420 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 681/1372] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:54.275296 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458c717-bf7c-45c3-9b99-2146f6acf325 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:54.276104 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458c717-bf7c-45c3-9b99-2146f6acf325 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:54.276640 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f458c717-bf7c-45c3-9b99-2146f6acf325 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:54.298420 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-f458c717-bf7c-45c3-9b99-2146f6acf325 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:54.299819 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-f458c717-bf7c-45c3-9b99-2146f6acf325 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:54.314282 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 692/1373] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:54.623874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a9dd-a0c8-4bf4-a68b-78e70412fd45 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:54.623874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a9dd-a0c8-4bf4-a68b-78e70412fd45 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:54.623874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b666a9dd-a0c8-4bf4-a68b-78e70412fd45 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:54.623874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 682/1374] 10.222.0.58 () {54 vars in 963 bytes} [Fri Jun 17 07:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:54.629357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ecc25-cbab-4e09-9e3e-951f8c23b13a None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:54.629357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ecc25-cbab-4e09-9e3e-951f8c23b13a None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:54.629357 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5ecc25-cbab-4e09-9e3e-951f8c23b13a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:54.688711 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-7b5ecc25-cbab-4e09-9e3e-951f8c23b13a None None] MFA Rules not processed for user `835467295bfb4450a64d06c813a360e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:54.689933 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-7b5ecc25-cbab-4e09-9e3e-951f8c23b13a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:54.781697 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 693/1375] 10.222.0.58 () {58 vars in 1060 bytes} [Fri Jun 17 07:19:54 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:19:54.790747 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a9dd-a0c8-4bf4-a68b-78e70412fd45 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:54.804008 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b666a9dd-a0c8-4bf4-a68b-78e70412fd45 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:54.808207 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb8ac66-ae3c-4144-aca1-c447cb40e74b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '835467295bfb4450a64d06c813a360e4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:54.809140 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ac66-ae3c-4144-aca1-c447cb40e74b service cinder] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:54.809433 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ac66-ae3c-4144-aca1-c447cb40e74b service cinder] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:54.809710 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb8ac66-ae3c-4144-aca1-c447cb40e74b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:54.820286 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ac66-ae3c-4144-aca1-c447cb40e74b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:54.821746 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb8ac66-ae3c-4144-aca1-c447cb40e74b service cinder] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:54.832874 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 683/1376] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:19:56.238762 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f72bc-9cae-4e1e-a786-471ec81510ca None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:56.239335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f72bc-9cae-4e1e-a786-471ec81510ca None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:56.239335 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f72bc-9cae-4e1e-a786-471ec81510ca None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:56.240880 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 694/1377] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:56.245940 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff756-c17f-4d5c-852a-3cdd47db7ab0 None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:56.246360 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff756-c17f-4d5c-852a-3cdd47db7ab0 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:56.246582 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ff756-c17f-4d5c-852a-3cdd47db7ab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:56.264825 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-b99ff756-c17f-4d5c-852a-3cdd47db7ab0 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:56.266071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-b99ff756-c17f-4d5c-852a-3cdd47db7ab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:56.274248 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 684/1378] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:19:56.319652 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f72bc-9cae-4e1e-a786-471ec81510ca None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:56.334657 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f72bc-9cae-4e1e-a786-471ec81510ca None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:56.340226 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b06ef-9810-4043-9b08-28f07b1fe198 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:56.340879 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b06ef-9810-4043-9b08-28f07b1fe198 service nova] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:56.341164 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b06ef-9810-4043-9b08-28f07b1fe198 service nova] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:56.341444 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b06ef-9810-4043-9b08-28f07b1fe198 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:56.350842 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b06ef-9810-4043-9b08-28f07b1fe198 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:56.352498 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b06ef-9810-4043-9b08-28f07b1fe198 service nova] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:56.356512 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=100 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:19:56.366076 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 695/1379] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:19:58.602555 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02c4e-b9ae-427b-b178-5595a26ff116 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:58.603200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02c4e-b9ae-427b-b178-5595a26ff116 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:58.603200 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c02c4e-b9ae-427b-b178-5595a26ff116 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:58.604521 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 685/1380] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:19:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:19:58.610502 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa1a4e-51ee-45b3-b673-b8aca457c44f None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:58.611391 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa1a4e-51ee-45b3-b673-b8aca457c44f None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:58.611847 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa1a4e-51ee-45b3-b673-b8aca457c44f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:58.642557 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-3ffa1a4e-51ee-45b3-b673-b8aca457c44f None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:19:58.644283 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-3ffa1a4e-51ee-45b3-b673-b8aca457c44f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:19:58.659678 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 696/1381] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:19:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jun 17 07:19:58.705951 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c02c4e-b9ae-427b-b178-5595a26ff116 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:19:58.724713 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c02c4e-b9ae-427b-b178-5595a26ff116 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:19:58.735955 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa64a2-059c-4285-a458-84f2cfb3fa7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:19:58.737266 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa64a2-059c-4285-a458-84f2cfb3fa7d service nova] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:19:58.737801 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa64a2-059c-4285-a458-84f2cfb3fa7d service nova] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:19:58.738498 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa64a2-059c-4285-a458-84f2cfb3fa7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:19:58.753468 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa64a2-059c-4285-a458-84f2cfb3fa7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:19:58.755465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa64a2-059c-4285-a458-84f2cfb3fa7d service nova] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:19:58.769867 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 686/1382] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:19:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:20:01.003129 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99533-f8b5-400f-80fb-efa7345a031e None None] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:20:01.003664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99533-f8b5-400f-80fb-efa7345a031e None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:20:01.003664 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d99533-f8b5-400f-80fb-efa7345a031e None None] PATH_INFO: `/` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:20:01.005337 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 697/1383] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:20:01.010671 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450be6-0eef-4857-bce3-0247449f37fc None None] REQUEST_METHOD: `POST` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:20:01.011139 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450be6-0eef-4857-bce3-0247449f37fc None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:20:01.011231 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23450be6-0eef-4857-bce3-0247449f37fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:20:01.032222 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.auth.core [None req-23450be6-0eef-4857-bce3-0247449f37fc None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80080) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:20:01.033410 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.fernet_utils [None req-23450be6-0eef-4857-bce3-0247449f37fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80080) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:20:01.041434 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 687/1384] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:20:01.084518 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99533-f8b5-400f-80fb-efa7345a031e None None] Authenticating user token {{(pid=80079) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:20:01.099714 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d99533-f8b5-400f-80fb-efa7345a031e None None] Validating token access rules against request {{(pid=80079) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:20:01.106363 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23755166-391b-4eca-9b61-cbefdef0bbb7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80079) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:20:01.107010 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755166-391b-4eca-9b61-cbefdef0bbb7 service nova] REQUEST_METHOD: `GET` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:20:01.107293 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755166-391b-4eca-9b61-cbefdef0bbb7 service nova] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:20:01.107598 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23755166-391b-4eca-9b61-cbefdef0bbb7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:20:01.116366 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23755166-391b-4eca-9b61-cbefdef0bbb7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:20:01.117926 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23755166-391b-4eca-9b61-cbefdef0bbb7 service nova] RBAC: Authorization granted {{(pid=80079) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:20:01.129065 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 698/1385] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:20:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jun 17 07:20:03.378477 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e8fa-3a90-4a04-beb0-3dbc59e7a4b1 None None] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:20:03.379071 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e8fa-3a90-4a04-beb0-3dbc59e7a4b1 None None] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:20:03.379465 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d6e8fa-3a90-4a04-beb0-3dbc59e7a4b1 None None] PATH_INFO: `/` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:20:03.382000 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 688/1386] 10.222.0.58 () {54 vars in 926 bytes} [Fri Jun 17 07:20:03 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jun 17 07:20:03.391039 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a7b2-c633-4ee8-80e8-64df8a5733f5 None None] REQUEST_METHOD: `POST` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:20:03.391649 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a7b2-c633-4ee8-80e8-64df8a5733f5 None None] SCRIPT_NAME: `/identity` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:20:03.391953 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a2a7b2-c633-4ee8-80e8-64df8a5733f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80079) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:20:03.419713 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.auth.core [None req-40a2a7b2-c633-4ee8-80e8-64df8a5733f5 None None] MFA Rules not processed for user `b8c1c83f1036474f9bd804fc73521ecc`. Rule list: `[]` (Enabled: `True`). {{(pid=80079) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jun 17 07:20:03.421927 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG keystone.common.fernet_utils [None req-40a2a7b2-c633-4ee8-80e8-64df8a5733f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80079) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jun 17 07:20:03.434481 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: [pid: 80079|app: 0|req: 699/1387] 10.222.0.58 () {58 vars in 1023 bytes} [Fri Jun 17 07:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jun 17 07:20:03.507496 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6e8fa-3a90-4a04-beb0-3dbc59e7a4b1 None None] Authenticating user token {{(pid=80080) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jun 17 07:20:03.523280 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d6e8fa-3a90-4a04-beb0-3dbc59e7a4b1 None None] Validating token access rules against request {{(pid=80080) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jun 17 07:20:03.529141 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851f9c64-96f9-4a54-9dc1-5815db79f603 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4f968a9c3d3d4dbfb71216af67cd291e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '884ab762591a499b8e10caea0511a886', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80080) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jun 17 07:20:03.530426 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9c64-96f9-4a54-9dc1-5815db79f603 service nova] REQUEST_METHOD: `GET` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jun 17 07:20:03.530711 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9c64-96f9-4a54-9dc1-5815db79f603 service nova] SCRIPT_NAME: `/identity` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jun 17 07:20:03.530996 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851f9c64-96f9-4a54-9dc1-5815db79f603 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80080) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jun 17 07:20:03.540271 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9c64-96f9-4a54-9dc1-5815db79f603 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jun 17 07:20:03.541894 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851f9c64-96f9-4a54-9dc1-5815db79f603 service nova] RBAC: Authorization granted {{(pid=80080) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jun 17 07:20:03.552736 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: [pid: 80080|app: 0|req: 689/1388] 10.222.0.58 () {60 vars in 1365 bytes} [Fri Jun 17 07:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jun 17 07:20:13.411007 dv-cinder-803773-3-iscsi devstack@keystone.service[80079]: DEBUG dbcounter [-] [80079] Writing DB stats keystone:SELECT=13 {{(pid=80079) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 17 07:20:13.548528 dv-cinder-803773-3-iscsi devstack@keystone.service[80080]: DEBUG dbcounter [-] [80080] Writing DB stats keystone:SELECT=42 {{(pid=80080) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}